-- Logs begin at Fri 2022-01-28 01:12:56 UTC, end at Fri 2022-01-28 02:13:16 UTC. -- Jan 28 01:48:04.639311 dv-cinder-824978-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 01:48:04.648559 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:48:04 2022] *** Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: nodename: dv-cinder-824978-1-iscsi Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: machine: x86_64 Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: clock source: unix Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: pcre jit disabled Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: detected number of CPU cores: 4 Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: current working directory: / Jan 28 01:48:04.650564 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:48:04.651230 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: your processes number limit is 47680 Jan 28 01:48:04.651230 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: your memory page size is 4096 bytes Jan 28 01:48:04.651230 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: detected max file descriptor number: 2048 Jan 28 01:48:04.651230 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: lock engine: pthread robust mutexes Jan 28 01:48:04.651230 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: thunder lock: enabled Jan 28 01:48:04.651230 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 01:48:04.651230 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:48:04.695236 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: Python main interpreter initialized at 0x5637043a79c0 Jan 28 01:48:04.695236 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: python threads support enabled Jan 28 01:48:04.695236 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: your server socket listen backlog is limited to 100 connections Jan 28 01:48:04.695236 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:48:04.695614 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:48:04.695702 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: *** Operational MODE: preforking *** Jan 28 01:48:04.695916 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:48:04.695916 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: spawned uWSGI master process (pid: 100650) Jan 28 01:48:04.696129 dv-cinder-824978-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 01:48:04.698810 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: spawned uWSGI worker 1 (pid: 100651, cores: 1) Jan 28 01:48:04.698810 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: spawned uWSGI worker 2 (pid: 100652, cores: 1) Jan 28 01:48:04.698810 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:48:06.374251 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:48:06.374251 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: from cryptography.utils import int_from_bytes Jan 28 01:48:06.374926 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:48:06.374926 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: from cryptography.utils import int_from_bytes Jan 28 01:48:06.401747 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:48:06.401747 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: from cryptography.utils import int_from_bytes Jan 28 01:48:06.402309 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:48:06.402309 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: from cryptography.utils import int_from_bytes Jan 28 01:48:09.067177 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:48:09.067766 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:48:09.067868 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:48:09.067868 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:48:09.068309 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:48:09.068309 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:48:09.068500 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:48:09.068586 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:48:09.068677 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:48:09.068856 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.068968 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:48:09.069181 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.069274 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.069512 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.069664 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.069851 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.069971 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.070177 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.070279 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.070568 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.070666 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.070875 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.071084 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.071179 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.071493 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.071591 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.071817 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.072039 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.072161 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.072300 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.072393 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.072616 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.072724 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824978-1-iscsi {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.072961 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824978-1-iscsi {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.073062 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.073282 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.073379 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.073585 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.073688 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.073888 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.073987 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.074184 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.074280 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.074488 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.074582 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.074785 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.074871 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.075094 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.075278 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.075593 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.075741 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.075898 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.076011 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.076196 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.076324 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.076499 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.076624 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.076848 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.076955 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.077159 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.077262 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.077461 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.077548 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.077774 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.077871 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.078076 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.078175 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.078394 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.078488 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.078695 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.078791 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824978-1-iscsi {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.079087 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824978-1-iscsi {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.079182 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.079390 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.079532 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.079685 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.079814 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.079996 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.080095 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.080398 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.080509 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.080700 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.080810 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.081027 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.081128 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.081343 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.081436 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.081646 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.081803 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.081949 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.082080 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.082268 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.082361 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.082583 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.082678 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.082896 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.082992 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.083190 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.083286 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.083493 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.083592 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.083796 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.083884 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.084099 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.084193 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.084398 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.084500 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.084699 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.084832 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.084974 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.085075 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.085299 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.085394 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.085663 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.085757 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.086053 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.086254 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.086337 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.086426 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.086598 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.086692 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.086844 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.086938 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.087087 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.087176 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.087400 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.087487 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.087716 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.087813 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.088021 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.088108 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.088323 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.088414 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.088623 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.088716 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.088946 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.089046 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.089250 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.089336 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.089547 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.089640 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.089846 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.089939 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.090145 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.090238 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.090459 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.090559 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.090769 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.090864 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.091070 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.091165 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.091377 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.091470 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.091691 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.091778 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.092000 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.092329 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.092438 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.092529 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.092677 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.092766 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.093092 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.093193 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.093398 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.093493 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.093702 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.093795 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.094016 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.094108 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.094321 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.094415 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.094623 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.094717 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.094923 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.095018 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.095227 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.095315 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.095542 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.095634 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.095839 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.095933 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.096084 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.096183 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.096377 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.096469 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.096674 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.096772 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.096995 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.097095 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.097311 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.097398 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.097611 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.097708 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.097910 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.097995 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.098204 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.098297 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.098528 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.098628 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.098831 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.098915 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.099130 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.099223 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.099431 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.099517 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.099729 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.099814 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.100027 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.100112 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.100327 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.100424 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.100625 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.100710 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.101465 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.101701 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.101840 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.101930 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.102069 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.102163 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.102385 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.102481 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.102689 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.102784 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.102991 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.103077 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.103296 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.103390 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.103598 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.103694 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.103913 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.104007 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.104211 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.104312 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.104511 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.104598 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.104839 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.104927 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.105141 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.105225 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.105441 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.105529 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.105739 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.105825 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.106042 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.106134 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.106341 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.106434 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.106639 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.106724 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.106939 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.107038 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.107238 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.107323 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.107538 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.107630 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.107838 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.107937 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.108150 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.108237 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.108431 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.108516 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.108728 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.108859 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.109048 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.109146 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.109343 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.109429 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.109637 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.109737 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.109928 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.110026 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.110222 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.110317 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.110538 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.110631 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.110839 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.110924 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.111139 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.111233 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.111436 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.111529 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.111731 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.111817 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.112046 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:09.112135 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.112389 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.112508 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.112711 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.112838 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.113046 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.113151 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.113377 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.113477 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.113701 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.113792 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.114013 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.114113 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.114320 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.114411 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.114624 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.114713 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.114934 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.115035 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.115237 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.115328 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.115540 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.115631 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.115841 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.115940 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.116145 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.116237 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.116454 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.117180 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.117332 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.117464 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.117664 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.117768 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.117975 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.118066 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.118290 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.118393 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.118597 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.118686 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.118909 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.118996 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.119233 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.119336 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.119549 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.119643 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.119856 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.119996 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.120192 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.120281 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.120531 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.120645 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.120858 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.120951 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.121184 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.121286 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.121494 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.121586 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.121801 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.121901 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.122107 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.122198 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.122415 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.122507 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.122720 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.122811 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.123031 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.123130 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.123335 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.123432 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.123645 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.123744 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.123953 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.124045 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.124273 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.124363 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.124581 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.124688 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.124905 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.124997 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.125208 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.125306 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.125507 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.125611 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.125807 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.125912 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.126105 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.126195 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.126404 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.126504 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.126720 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.126820 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.127021 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.127111 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.127330 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.127421 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.127640 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.127732 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.127947 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.128037 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.128249 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.128346 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.128548 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.128640 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.128865 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.128957 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.129173 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.129264 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.129474 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.129566 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.129773 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.129871 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.130084 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.130231 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.130386 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.130477 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.130690 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.130801 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.130990 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.131079 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.131290 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.131389 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.131588 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.131684 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.131891 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.131988 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.132240 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.132334 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.132550 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.132719 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.132893 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.133201 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.133288 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.133527 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.133703 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.133837 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.133924 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.134146 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.134233 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.134478 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.134573 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.134808 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.134901 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.135111 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.135198 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.135424 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.135518 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.135725 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.135812 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.136032 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.136126 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.136330 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.136424 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.136631 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.136724 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.136949 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.137039 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.137252 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.137360 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.137549 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.137636 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.137851 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.137943 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.138149 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.138237 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.138445 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.138531 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.138743 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.138829 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.139042 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.139129 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.139342 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.139429 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.139636 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.139723 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.139933 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.140027 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.140229 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.140323 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.140525 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.140611 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.140915 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.141010 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.141170 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.141258 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.141473 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.141574 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.141839 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.141956 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.142132 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.142232 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.142648 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.142750 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.142839 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.142920 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.143030 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.143118 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.143335 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.143432 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.143639 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.143726 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.143942 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.144028 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.144245 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.144872 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.144872 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145043 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145043 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145202 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145291 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145372 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145478 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145574 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145781 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.145867 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.146097 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.146186 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.146397 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.146485 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.146709 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.146795 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.147007 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.147095 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.147321 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.147411 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.147657 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.148229 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.148537 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.148702 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.148995 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.149099 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.149313 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.149410 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.149622 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.149718 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.149931 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.150018 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.150239 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.150384 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.150543 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.150629 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.150847 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.150947 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.151156 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.151268 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.151465 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.151551 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.151770 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.151864 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.152086 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.152186 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.152389 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.152482 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.152703 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.152810 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.153029 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.153130 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.153338 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.153427 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.153644 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.153729 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.153955 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.154044 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.154265 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.154352 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.154573 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.154667 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.154885 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.154973 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.155187 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.155281 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.155491 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.155585 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.155793 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.155880 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.156089 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.156175 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.156390 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.156482 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.156686 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.156774 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.157021 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.157110 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.157392 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.157749 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.157888 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.158086 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.158233 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.158378 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.158510 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.158692 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.158831 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.159000 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.159148 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.159294 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.159452 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.159620 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.159765 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.159906 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.160043 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.160169 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.160291 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.160472 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.160602 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.160839 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.160984 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.161133 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.161328 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.161462 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.161562 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.161745 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.161869 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.162029 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.162178 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.162352 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.162514 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.162654 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.162785 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.162944 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.163204 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.163356 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.164105 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.164258 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.164416 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.164559 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.164820 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.164964 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.165105 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.165264 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.165417 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.165560 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.165718 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.165860 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.166004 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.166145 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.166300 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.166454 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.166597 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.166737 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.166877 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.167014 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.167191 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.167351 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.167491 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.167629 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.167772 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.167917 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.168058 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.168211 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.168351 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.168490 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.168643 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.168787 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.168981 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.169135 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.169276 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.169419 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.169569 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.169724 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.169892 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.170036 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.170189 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.170343 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.170496 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.170641 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.170797 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.170940 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.171082 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.171304 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.171581 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.171736 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.171897 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.172086 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.172210 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.172333 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.172499 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.172646 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.172867 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.173015 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.173174 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.173319 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.173457 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.173623 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.173768 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.173976 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.174126 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.174263 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.174382 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.174521 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.174669 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.174825 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.174968 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.175116 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.175242 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.175396 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.175540 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.175685 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.175830 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.175954 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.176104 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.176260 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.176405 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.176549 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.176681 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.176849 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.177012 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.177160 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.177312 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.177457 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.177602 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.177750 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.177901 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.178034 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.178185 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.178349 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.178492 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.178648 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.178797 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.178942 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.179089 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.179245 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.179390 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.179535 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.179687 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.179836 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.179980 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.180101 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.180270 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.180419 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.180561 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.180772 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.181011 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.181158 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.181370 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.181576 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.181726 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.181872 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.182036 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.182176 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.182322 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.182465 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.182611 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.182769 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.182906 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.183051 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.183206 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.183354 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.183497 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.183651 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.183811 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.183950 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.184090 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.184233 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.184379 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.184538 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.184678 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.184846 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.184846 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.185135 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.185279 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.185435 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.185599 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.185756 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.185896 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.186032 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.186189 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.186336 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.186495 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.186636 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.186781 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.186927 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.187180 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.187326 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.187471 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.187617 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.187763 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.187904 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.188064 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.188224 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.188369 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.188514 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.188660 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.188874 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.189041 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.189198 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.189347 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.189489 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.189636 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.189799 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.189942 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.190070 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.190191 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.190326 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.190458 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.190606 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.190754 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.190899 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.191130 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.191280 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.191487 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.191650 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.191799 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.191947 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.192090 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.192217 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.192330 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.192440 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.192559 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.192686 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.192829 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.192973 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.193098 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.193236 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.193360 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.193493 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.193619 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.193750 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.193884 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.194011 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.194134 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.194255 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.194377 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.194498 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.194641 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.194780 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.194926 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.195063 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.195199 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.195331 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.195475 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.195616 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.195746 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.195878 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.196013 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.196163 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.196303 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.196433 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.196563 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.196705 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.196859 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.197015 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.197146 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.197277 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.197412 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.197542 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.197669 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.197813 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.197943 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.198084 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.198218 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.198384 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.198519 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.198691 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.198836 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.198978 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.199119 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.199306 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.199454 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.199593 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.199727 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.199947 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.200094 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.200241 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.200389 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.200527 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.200675 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.200881 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.201019 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.201219 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.201384 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.201580 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.201772 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.201903 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.202031 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.202161 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.202297 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.202424 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.202551 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.202693 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.202825 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.202954 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.203097 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.203228 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.203353 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.203485 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.203618 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.203759 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.203894 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.204045 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.204184 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.204365 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.204511 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.204661 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.204842 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.205015 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.205174 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.205313 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.205449 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.205607 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.205745 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.205880 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.206015 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.206186 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.206339 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.206486 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.206622 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.206785 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.206932 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.207075 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.207224 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.207389 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.207529 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.207691 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.207833 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.207974 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.208130 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.208276 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.208403 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.208570 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.208706 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.208894 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.209042 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.209169 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.209303 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.209474 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.209612 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.209771 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.209909 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.210087 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.210684 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.211256 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.211416 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.211597 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.211741 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.211886 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.212022 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.212152 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.212288 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.212426 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.212558 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.212696 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.212858 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.212991 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.213129 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.213282 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.213764 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.213916 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.214058 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.214210 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.214349 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.214496 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.214635 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.214780 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.214917 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.215066 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.215323 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.215474 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.215622 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.215742 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.215864 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.216001 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.216146 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.216273 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.216396 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.216519 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.216642 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.216768 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.216991 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.217119 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.217254 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.217379 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.217503 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.217629 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.217766 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.217892 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.218022 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.218154 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.218286 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.218436 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.218567 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.218696 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.218826 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.218959 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.219101 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.219245 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.219379 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.219508 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.219638 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.219769 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.219899 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.220048 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.220188 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.220327 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.220596 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.220761 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.220930 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.221089 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.221238 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.221441 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.221591 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.221793 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.221994 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.222141 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.222269 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.222398 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.222523 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.222706 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.222852 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.222987 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.223121 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.223263 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.223392 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.223524 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.223672 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.223811 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.223944 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.224090 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.224229 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.224375 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.224533 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.224673 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.224833 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.224986 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.225127 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.225278 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.225425 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.225564 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.225711 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.225871 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.226798 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.226974 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.227125 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.227269 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.227413 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.227607 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.227749 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.227877 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.228041 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.228183 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.228342 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.228471 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.228646 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.228875 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.229017 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.229161 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.229297 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.229448 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.229588 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.229727 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.229865 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.230017 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.230161 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.230308 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.230455 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.230602 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.230763 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.230888 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.231016 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.231139 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.231335 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.231525 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.231666 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.231850 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.231992 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.232118 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.232242 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.232376 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.232535 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.232678 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.232856 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.232993 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.233118 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.233258 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.233404 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.233540 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.233690 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.233828 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.234008 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.234170 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.234318 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.234458 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.234595 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.234756 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.234896 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.235056 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.235217 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.235366 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.235505 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.235634 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.235759 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.235897 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.236079 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.236215 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.236410 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.236556 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.236710 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.236919 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.237058 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.237197 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.237365 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.237520 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.237671 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.237814 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.237988 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.238143 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.238300 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.238445 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.238594 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.238738 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.238875 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.239013 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.239154 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.239301 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.239462 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.239612 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.239757 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.239887 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.240022 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.240160 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.240298 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.240423 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.240609 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.240754 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.240921 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.241064 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.241195 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.241319 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.241549 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.241738 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.241898 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.242083 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.242229 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.242371 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.242511 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.242661 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.242802 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.242942 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.243071 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.243197 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.243339 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.243472 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.243603 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.243755 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.243893 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.244030 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.244170 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.244319 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.244529 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.244672 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.244878 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.245025 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.245165 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.245313 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.245479 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.245627 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.245773 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.245900 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.246037 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.246174 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.246312 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.246437 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.246612 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.246743 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.246925 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.247079 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.247232 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.247362 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.247528 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.247665 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.247835 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.247991 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.248130 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.248266 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.248421 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.248565 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.248713 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.248914 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.249066 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.249204 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.249332 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.249458 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.249857 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.250007 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.250180 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.250317 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.250489 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.250631 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.250795 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.250947 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.251095 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.251236 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.251405 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.251548 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.251701 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.251840 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.251992 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.252118 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.252295 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.252438 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.252598 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.252739 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.252937 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.253096 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.253255 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.253399 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.253586 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.253724 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.253864 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.254018 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.254166 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.254335 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.254482 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.254631 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.254761 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.254880 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.255039 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.255188 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.255350 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.255481 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.255700 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.255834 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.256008 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.256137 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.256310 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.256440 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.256618 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.256752 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.256973 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.257131 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.257279 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.257431 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.257573 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.257722 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.257862 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.258012 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.258146 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.258273 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.258449 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.258608 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.258744 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.258875 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.259045 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.259198 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.259337 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.259488 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.259632 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.259771 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.259958 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.260102 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.260346 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.260490 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.260637 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.260786 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.260959 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.261105 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.261271 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.261420 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.261539 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.261650 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.262013 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.262209 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.262362 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.262494 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.262618 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.262756 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.262945 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.263091 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.263265 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.263412 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.263580 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.263726 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.263900 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.264065 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.264220 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.264368 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.264507 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.264664 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.264841 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.265008 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.265157 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.265300 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.265447 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.265586 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.265712 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.265856 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.265988 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.266139 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.266279 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.266436 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.266585 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.266782 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.266929 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.267061 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.267187 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.267312 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.267671 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.267808 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.268016 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.268213 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.268350 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.268485 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.268647 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.268788 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.268959 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.269103 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.269265 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.269413 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.269581 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.269728 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.269871 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.269999 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.270125 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.270250 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.270433 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.270567 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.270740 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.270872 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.271050 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.271206 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.271354 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.271480 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.271642 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.271796 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.271936 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.272088 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.272293 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.272437 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.272649 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.273398 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.273398 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.273693 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.273842 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.274033 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.274164 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.274314 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.274445 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.274593 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.274735 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.274882 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.275030 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.275178 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.275338 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.275473 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.275599 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.275725 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.275851 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.275989 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.276134 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.276270 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.276407 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.276546 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.276689 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.276858 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.277027 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.277174 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.277721 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.277871 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.278005 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.278142 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.278301 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.278442 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.278587 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.278747 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.278896 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.279049 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.279192 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.279335 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.279482 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.279625 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.279769 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.279927 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.280070 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.280207 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.280367 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.280458 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.280538 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.280683 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.280863 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.280978 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.281086 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.281204 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.281289 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.281423 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.281557 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.281701 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.281897 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.282039 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.282375 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.282862 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.283002 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.283201 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.283381 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.283531 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.283657 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.283968 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.284072 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.284274 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.284427 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.284575 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.284734 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.284906 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.285033 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.285210 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.285366 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.285509 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.285656 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.285799 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.285943 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.286086 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.286230 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.286382 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.286518 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.286696 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.286860 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.287026 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.287172 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.287336 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.287483 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.287626 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.287781 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.287937 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.288082 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.288242 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.288435 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.289177 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.289322 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.289466 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.289681 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.289839 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.289982 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.290124 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.290271 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.290424 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.290581 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.290731 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.290865 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.290982 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.291171 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.291319 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.291477 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.291620 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.291777 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.291987 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.292137 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.292278 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.292432 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.292572 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.292719 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.292891 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.293040 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.293202 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.293361 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.293503 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.293712 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.293884 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.294034 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.294199 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.294345 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.294500 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.294653 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.294809 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.294969 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.295111 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.295267 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.295423 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.295574 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.295708 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.295866 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.296012 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.296161 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.296305 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.296449 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.296596 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.296861 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.297009 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.297176 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.297324 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.297470 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.297726 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.297726 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.298004 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.298152 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.298300 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.298448 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.298609 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.298609 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.298875 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.299031 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.299154 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.299275 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.299410 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.299565 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.299710 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.299868 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.300025 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.300171 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.300329 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.300478 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.300624 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.300769 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.300938 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.301110 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.301253 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.301400 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.301552 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.301696 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.301823 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.301959 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.302072 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.302196 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.302318 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.302492 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.302641 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.302795 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.302929 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.303096 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.303242 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.303389 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.303546 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.303718 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.303877 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.304061 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.304197 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.304331 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.304486 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.304731 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.304914 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.305063 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.305205 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.305338 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.305494 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.305641 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.305800 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.305949 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.306095 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.306237 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.306389 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.306517 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.306643 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.306768 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.306898 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.307081 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.307220 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.307387 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.307528 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.307695 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.307849 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.308009 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.308157 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.308305 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.308452 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.308599 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.308743 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.308935 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.309066 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.309238 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.309378 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.309561 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.309727 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.309868 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.310012 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.310214 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.310367 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.310517 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.310682 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.310826 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:48:09.310952 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.311154 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:09.311393 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:48:09.333237 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:09.334184 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_db.sqlalchemy.engines [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:09.509289 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.context [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8452b107-e1f7-4d38-8e73-ac08c235b44e(cell1) {{(pid=100651) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:48:09.510145 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.context [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8452b107-e1f7-4d38-8e73-ac08c235b44e(cell1) {{(pid=100652) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:48:09.513502 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG oslo_concurrency.lockutils [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:48:09.514301 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:48:09.515093 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG oslo_concurrency.lockutils [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:48:09.515887 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG oslo_concurrency.lockutils [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:48:09.515989 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:48:09.516664 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:48:09.517844 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG oslo_concurrency.lockutils [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:48:09.518641 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:48:09.528639 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:09.533188 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_db.sqlalchemy.engines [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:09.535723 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_db.sqlalchemy.engines [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:09.538011 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:09.799705 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_db.sqlalchemy.engines [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:09.806777 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:10.151103 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: WARNING keystonemiddleware.auth_token [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:48:10.151981 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: WARNING keystonemiddleware.auth_token [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:48:10.157791 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: WARNING keystonemiddleware.auth_token [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:48:10.158739 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: WARNING keystonemiddleware.auth_token [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:48:10.506406 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: WARNING keystonemiddleware.auth_token [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:48:10.511370 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: WARNING keystonemiddleware.auth_token [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:48:10.513270 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: WARNING keystonemiddleware.auth_token [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:48:10.516467 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: WARNING keystonemiddleware.auth_token [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:48:10.519278 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637043a79c0 pid: 100652 (default app) Jan 28 01:48:10.521811 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637043a79c0 pid: 100651 (default app) Jan 28 01:48:10.522143 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:48:10.523803 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-8039e6b8-0325-47cf-9b37-668a229ef6e2 None None] 10.222.0.96 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002443 Jan 28 01:48:10.524508 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 1/1] 10.222.0.96 () {50 vars in 788 bytes} [Fri Jan 28 01:48:10 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:32.081439 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:32.082826 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003001 Jan 28 01:49:32.083260 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 1/2] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:32.532262 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-7eab6db7-e8a3-4fa1-8763-0985055485f5 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:32.562337 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-7eab6db7-e8a3-4fa1-8763-0985055485f5 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.470759 Jan 28 01:49:32.563042 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 2/3] 10.222.0.96 () {60 vars in 1291 bytes} [Fri Jan 28 01:49:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:49:34.821005 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:34.822022 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-6b9abba4-8df2-42c9-90e5-0f23e1a7c1d7 None None] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002355 Jan 28 01:49:34.822471 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 2/4] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:34.903772 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-c699b7e6-f590-4311-a79f-3014227cd104 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "swap": 0, "name": "cirros256", "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:34.926592 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:34.926592 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: warnings.warn(msg) Jan 28 01:49:34.955821 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-c699b7e6-f590-4311-a79f-3014227cd104 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.126737 Jan 28 01:49:34.956768 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 3/5] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:49:35.195902 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-588e2224-3cb2-400e-a87d-c0ff260459e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:35.198258 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:35.198258 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: warnings.warn(msg) Jan 28 01:49:35.247820 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-588e2224-3cb2-400e-a87d-c0ff260459e4 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282274 Jan 28 01:49:35.248607 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 3/6] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Jan 28 01:49:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:49:37.525336 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-c699b7e6-f590-4311-a79f-3014227cd104 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:37.526336 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-c699b7e6-f590-4311-a79f-3014227cd104 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jan 28 01:49:37.526753 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 4/7] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:37.665357 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-8cad1a25-13f3-46b1-bdce-be8280c9f2cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "swap": 0}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:37.684067 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:37.684067 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: warnings.warn(msg) Jan 28 01:49:37.704935 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-8cad1a25-13f3-46b1-bdce-be8280c9f2cc admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.171514 Jan 28 01:49:37.705393 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 4/8] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:49:37.717855 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-3d64f3fe-e814-44f1-9a76-d6a999c18413 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:37.719527 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:37.719527 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: warnings.warn(msg) Jan 28 01:49:37.758434 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-3d64f3fe-e814-44f1-9a76-d6a999c18413 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044193 Jan 28 01:49:37.759344 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 5/9] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Jan 28 01:49:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:49:40.064662 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-8cad1a25-13f3-46b1-bdce-be8280c9f2cc admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:40.065690 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-8cad1a25-13f3-46b1-bdce-be8280c9f2cc admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jan 28 01:49:40.066440 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 5/10] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:40.129402 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-71625f68-e1d6-41a1-bef0-660c20962841 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "vcpus": 1, "ram": 1024}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:40.150816 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-71625f68-e1d6-41a1-bef0-660c20962841 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077085 Jan 28 01:49:40.152009 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 6/11] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:49:40.165329 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-34c8475d-ba0c-4b9d-9226-40d43bf048f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:40.198801 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-34c8475d-ba0c-4b9d-9226-40d43bf048f3 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037766 Jan 28 01:49:40.200068 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 6/12] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Jan 28 01:49:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:49:42.477940 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-71625f68-e1d6-41a1-bef0-660c20962841 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:42.479211 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-71625f68-e1d6-41a1-bef0-660c20962841 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jan 28 01:49:42.479211 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 7/13] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:42.567489 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-43047f45-c4b7-4ede-83af-b1d654ba1d00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "vcpus": 2, "name": "ds2G"}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:42.586049 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-43047f45-c4b7-4ede-83af-b1d654ba1d00 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099734 Jan 28 01:49:42.586737 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 7/14] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:49:42.598889 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-7bf55ebe-c690-4bec-a982-8528ad3ecfc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:42.621802 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-7bf55ebe-c690-4bec-a982-8528ad3ecfc6 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026598 Jan 28 01:49:42.622482 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 8/15] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Jan 28 01:49:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:49:44.928525 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-43047f45-c4b7-4ede-83af-b1d654ba1d00 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:44.929689 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-43047f45-c4b7-4ede-83af-b1d654ba1d00 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001854 Jan 28 01:49:44.930091 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 8/16] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:44.991855 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-cb281775-888f-4772-81a9-2a8405279a1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:45.010839 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-cb281775-888f-4772-81a9-2a8405279a1e admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074036 Jan 28 01:49:45.019543 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 9/17] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:49:45.025897 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-cb61d50f-418a-45d5-a9c5-f87a2f605b98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:45.049593 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-cb61d50f-418a-45d5-a9c5-f87a2f605b98 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028326 Jan 28 01:49:45.050169 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 9/18] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Jan 28 01:49:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:49:47.324269 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-cb281775-888f-4772-81a9-2a8405279a1e admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:47.325466 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-cb281775-888f-4772-81a9-2a8405279a1e admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 28 01:49:47.326134 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 10/19] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:47.410000 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-8edf9a13-deae-476f-8466-27823a750a5c admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:47.437861 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-8edf9a13-deae-476f-8466-27823a750a5c admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.104712 Jan 28 01:49:47.456332 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 10/20] 10.222.0.96 () {60 vars in 1291 bytes} [Fri Jan 28 01:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:49:50.172838 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-cb281775-888f-4772-81a9-2a8405279a1e admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:50.173834 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-cb281775-888f-4772-81a9-2a8405279a1e admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 28 01:49:50.174232 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 11/21] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:49:50.235612 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-0da5eaae-6d72-4ce3-b2ea-7c8099827467 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:50.256237 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-0da5eaae-6d72-4ce3-b2ea-7c8099827467 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074635 Jan 28 01:49:50.256966 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 11/22] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:49:50.269383 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-ab064393-c5df-4108-a647-b7a4d1a4e835 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:50.293598 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-ab064393-c5df-4108-a647-b7a4d1a4e835 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027778 Jan 28 01:49:50.294184 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 12/23] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Jan 28 01:49:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:49:52.620879 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-0da5eaae-6d72-4ce3-b2ea-7c8099827467 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:52.621876 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-0da5eaae-6d72-4ce3-b2ea-7c8099827467 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jan 28 01:49:52.622270 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 12/24] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:52.690985 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-56835b12-adeb-4803-bef2-908e2f2b18df admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:52.717326 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-56835b12-adeb-4803-bef2-908e2f2b18df admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087951 Jan 28 01:49:52.718172 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 13/25] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:49:52.731411 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-1a240bcc-d613-427b-8006-c2e75c883de4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:52.756826 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-1a240bcc-d613-427b-8006-c2e75c883de4 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028734 Jan 28 01:49:52.757399 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 13/26] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Jan 28 01:49:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:49:55.091439 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-56835b12-adeb-4803-bef2-908e2f2b18df admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:55.093016 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-56835b12-adeb-4803-bef2-908e2f2b18df admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002377 Jan 28 01:49:55.093433 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 14/27] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:55.157978 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-c026c7e5-ea21-49dd-b163-5aba927090e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "swap": 0, "id": "3", "vcpus": 2}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:55.179495 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-c026c7e5-ea21-49dd-b163-5aba927090e7 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078279 Jan 28 01:49:55.180048 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 14/28] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:49:55.194238 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-2d889155-d066-4384-9bf2-b8a4c59c8698 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:55.219196 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-2d889155-d066-4384-9bf2-b8a4c59c8698 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029254 Jan 28 01:49:55.219982 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 15/29] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Jan 28 01:49:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:49:57.698130 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-c026c7e5-ea21-49dd-b163-5aba927090e7 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:49:57.699121 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-c026c7e5-ea21-49dd-b163-5aba927090e7 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jan 28 01:49:57.699517 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 15/30] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:49:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:49:57.766607 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-ef60ed85-2171-47c6-aeda-3cee441aacde admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "id": "4", "vcpus": 4}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:57.787974 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-ef60ed85-2171-47c6-aeda-3cee441aacde admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081891 Jan 28 01:49:57.788879 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 16/31] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:49:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:49:57.801409 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-f7540a3d-17b7-4cd5-b33c-410c9e01f73c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:49:57.826512 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-f7540a3d-17b7-4cd5-b33c-410c9e01f73c admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028605 Jan 28 01:49:57.827354 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 16/32] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Jan 28 01:49:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:50:00.138228 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-ef60ed85-2171-47c6-aeda-3cee441aacde admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:00.139261 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-ef60ed85-2171-47c6-aeda-3cee441aacde admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jan 28 01:50:00.139892 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 17/33] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:50:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:50:00.208517 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-3e8cb316-89ff-4cf7-8e32-d21691fafe7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "vcpus": 8, "swap": 0, "name": "m1.xlarge"}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:50:00.232046 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-3e8cb316-89ff-4cf7-8e32-d21691fafe7e admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084600 Jan 28 01:50:00.232904 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 17/34] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Jan 28 01:50:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:50:00.245475 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-07b666ae-600a-4ba9-8c97-cd88023b0e97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:50:00.275669 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-07b666ae-600a-4ba9-8c97-cd88023b0e97 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033834 Jan 28 01:50:00.276724 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 18/35] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Jan 28 01:50:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:50:39.761701 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-3e8cb316-89ff-4cf7-8e32-d21691fafe7e admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:39.762687 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-3e8cb316-89ff-4cf7-8e32-d21691fafe7e admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jan 28 01:50:39.763081 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 18/36] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:50:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:50:39.819981 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-f3680690-18e0-4c37-bd8f-b41756aed1c2 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:39.836419 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-f3680690-18e0-4c37-bd8f-b41756aed1c2 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066701 Jan 28 01:50:39.837135 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 19/37] 10.222.0.96 () {60 vars in 1291 bytes} [Fri Jan 28 01:50:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:50:41.298206 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-3e8cb316-89ff-4cf7-8e32-d21691fafe7e admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:41.299184 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-3e8cb316-89ff-4cf7-8e32-d21691fafe7e admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 28 01:50:41.299579 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 19/38] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:50:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:50:41.494013 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-4dc3afc3-1366-4a5f-bfef-9de82a5071a6 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:41.499394 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.wsgi [None req-4dc3afc3-1366-4a5f-bfef-9de82a5071a6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 01:50:41.499944 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-4dc3afc3-1366-4a5f-bfef-9de82a5071a6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:50:41.501450 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-4dc3afc3-1366-4a5f-bfef-9de82a5071a6 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061562 Jan 28 01:50:41.501934 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 20/39] 10.222.0.96 () {60 vars in 1190 bytes} [Fri Jan 28 01:50:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:41.511994 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-46938865-1942-438b-9c43-865073d8da88 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:41.533255 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-46938865-1942-438b-9c43-865073d8da88 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024686 Jan 28 01:50:41.533811 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 20/40] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Jan 28 01:50:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:50:41.544328 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-358692e2-f832-4b77-ac90-1c29e65baf1f admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:41.566125 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-358692e2-f832-4b77-ac90-1c29e65baf1f admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025204 Jan 28 01:50:41.566673 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 21/41] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Jan 28 01:50:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:50:41.576736 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-9a22829b-80e8-404e-90b0-023199942e78 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:41.582986 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.wsgi [None req-9a22829b-80e8-404e-90b0-023199942e78 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 01:50:41.583544 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-9a22829b-80e8-404e-90b0-023199942e78 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:50:41.584318 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-9a22829b-80e8-404e-90b0-023199942e78 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011199 Jan 28 01:50:41.584824 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 21/42] 10.222.0.96 () {60 vars in 1190 bytes} [Fri Jan 28 01:50:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 01:50:42.944246 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-358692e2-f832-4b77-ac90-1c29e65baf1f admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:42.945290 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-358692e2-f832-4b77-ac90-1c29e65baf1f admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jan 28 01:50:42.945687 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 22/43] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:50:43.137774 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-35564548-c446-4806-a928-3a6455e010d5 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:43.143542 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.wsgi [None req-35564548-c446-4806-a928-3a6455e010d5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 01:50:43.144100 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-35564548-c446-4806-a928-3a6455e010d5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:50:43.144908 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-35564548-c446-4806-a928-3a6455e010d5 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058102 Jan 28 01:50:43.145422 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 22/44] 10.222.0.96 () {60 vars in 1190 bytes} [Fri Jan 28 01:50:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:43.155344 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-89e5d3e6-7e96-4a34-a70a-9fbdd66fafc9 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:43.168760 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-89e5d3e6-7e96-4a34-a70a-9fbdd66fafc9 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016975 Jan 28 01:50:43.169317 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 23/45] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Jan 28 01:50:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:50:43.179191 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-3cdc5799-8a5b-48be-8342-edd49ca34372 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:43.192659 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-3cdc5799-8a5b-48be-8342-edd49ca34372 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016926 Jan 28 01:50:43.193222 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 23/46] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Jan 28 01:50:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:50:43.203008 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-c5b4afa3-be9d-435f-b417-cda046793181 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:43.208644 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.wsgi [None req-c5b4afa3-be9d-435f-b417-cda046793181 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 01:50:43.209243 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-c5b4afa3-be9d-435f-b417-cda046793181 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:50:43.210018 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-c5b4afa3-be9d-435f-b417-cda046793181 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010492 Jan 28 01:50:43.210504 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 24/47] 10.222.0.96 () {60 vars in 1190 bytes} [Fri Jan 28 01:50:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:44.574276 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-3cdc5799-8a5b-48be-8342-edd49ca34372 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:44.575273 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-3cdc5799-8a5b-48be-8342-edd49ca34372 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jan 28 01:50:44.575776 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 24/48] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:50:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:50:44.765767 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-ae0c78a8-663a-485d-a787-d66688ae5e99 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:44.772140 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.wsgi [None req-ae0c78a8-663a-485d-a787-d66688ae5e99 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 01:50:44.772698 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-ae0c78a8-663a-485d-a787-d66688ae5e99 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:50:44.773505 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-ae0c78a8-663a-485d-a787-d66688ae5e99 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057882 Jan 28 01:50:44.773999 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 25/49] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Jan 28 01:50:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:44.784492 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-8d67c312-6772-48c9-a11d-ed1b6177e2c6 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:44.798513 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-8d67c312-6772-48c9-a11d-ed1b6177e2c6 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017990 Jan 28 01:50:44.799052 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 25/50] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Jan 28 01:50:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:50:44.809100 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:44.823311 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017639 Jan 28 01:50:44.823842 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 26/51] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Jan 28 01:50:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:50:44.834100 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-0b50b293-39c4-4bc5-8d3a-aff400527f16 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:44.839162 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.wsgi [None req-0b50b293-39c4-4bc5-8d3a-aff400527f16 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 01:50:44.839709 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-0b50b293-39c4-4bc5-8d3a-aff400527f16 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:50:44.840466 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-0b50b293-39c4-4bc5-8d3a-aff400527f16 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009972 Jan 28 01:50:44.840976 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 26/52] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Jan 28 01:50:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 01:50:46.205474 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:46.206466 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001813 Jan 28 01:50:46.206862 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 27/53] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:50:46.406178 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-450ab057-33bd-451a-bdba-44e2e2167bcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:50:46.426238 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-450ab057-33bd-451a-bdba-44e2e2167bcb admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072192 Jan 28 01:50:46.426703 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 27/54] 10.222.0.96 () {64 vars in 1235 bytes} [Fri Jan 28 01:50:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:50:47.825965 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:47.826955 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Jan 28 01:50:47.827352 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 28/55] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:50:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:50:48.019337 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-01c86f27-4e55-418d-bd30-b82aca478d39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:50:48.037187 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-01c86f27-4e55-418d-bd30-b82aca478d39 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070152 Jan 28 01:50:48.037730 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 28/56] 10.222.0.96 () {64 vars in 1235 bytes} [Fri Jan 28 01:50:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:50:49.402921 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:49.403932 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 28 01:50:49.404319 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 29/57] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:50:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:50:49.598009 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-f7da4723-beef-4736-ab60-67661eb1440a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:50:49.616414 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-f7da4723-beef-4736-ab60-67661eb1440a admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070708 Jan 28 01:50:49.616926 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 29/58] 10.222.0.96 () {64 vars in 1235 bytes} [Fri Jan 28 01:50:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:50:50.992974 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:50.993992 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jan 28 01:50:50.994415 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 30/59] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:50:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:50:51.192612 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-476e0ad6-0a4c-4273-9f75-4910027c1235 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:50:51.211082 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-476e0ad6-0a4c-4273-9f75-4910027c1235 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072644 Jan 28 01:50:51.211553 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 30/60] 10.222.0.96 () {64 vars in 1235 bytes} [Fri Jan 28 01:50:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:50:52.580890 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:52.581877 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jan 28 01:50:52.582371 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 31/61] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:50:52.772105 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-c9ae3106-397f-4740-b57e-37a940ab9c2a admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:50:52.791411 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-c9ae3106-397f-4740-b57e-37a940ab9c2a admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069482 Jan 28 01:50:52.791872 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 31/62] 10.222.0.96 () {60 vars in 1202 bytes} [Fri Jan 28 01:50:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:51:34.717060 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:51:34.718064 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-21048bc5-77a2-4556-a9ca-df94a9d223e3 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jan 28 01:51:34.718474 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 32/63] 10.222.0.96 () {54 vars in 930 bytes} [Fri Jan 28 01:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:51:34.778460 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-e639671b-4047-4dd9-ad32-e67c2aca53ce admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:51:34.797597 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-e639671b-4047-4dd9-ad32-e67c2aca53ce admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072527 Jan 28 01:51:34.798136 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 32/64] 10.222.0.96 () {60 vars in 1291 bytes} [Fri Jan 28 01:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:51:34.821182 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-96fca7ed-fd1d-449b-a7fc-f540c73a3626 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:51:34.829573 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-96fca7ed-fd1d-449b-a7fc-f540c73a3626 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011967 Jan 28 01:51:34.830112 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 33/65] 10.222.0.96 () {60 vars in 1282 bytes} [Fri Jan 28 01:51:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:51:34.842507 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-2823c0b2-76c9-4d7c-bd6c-d88c1ed20acb admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:51:34.852214 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-2823c0b2-76c9-4d7c-bd6c-d88c1ed20acb admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013464 Jan 28 01:51:34.852781 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 33/66] 10.222.0.96 () {60 vars in 1285 bytes} [Fri Jan 28 01:51:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:51:34.866075 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-c400a0e6-4a4e-4dfa-80ac-3ea7d0d63c75 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:51:34.874823 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-c400a0e6-4a4e-4dfa-80ac-3ea7d0d63c75 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012906 Jan 28 01:51:34.875377 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 34/67] 10.222.0.96 () {60 vars in 1285 bytes} [Fri Jan 28 01:51:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:51:34.890932 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:51:34.900296 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016344 Jan 28 01:51:34.900847 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 34/68] 10.222.0.96 () {60 vars in 1282 bytes} [Fri Jan 28 01:51:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:53:04.692872 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-64490f8b-1932-4d2c-9c56-0e72e5aa349f tempest-verify_tempest_config-1712702567 tempest-verify_tempest_config-1712702567-project] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:53:04.694808 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-64490f8b-1932-4d2c-9c56-0e72e5aa349f tempest-verify_tempest_config-1712702567 tempest-verify_tempest_config-1712702567-project] 10.222.0.96 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105366 Jan 28 01:53:04.695481 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 35/69] 10.222.0.96 () {58 vars in 1133 bytes} [Fri Jan 28 01:53:04 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:40.211109 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:40.213168 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002474 Jan 28 01:54:40.213941 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 35/70] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:40.502975 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-6922d0fe-7402-41bf-8a8f-f297a5598c38 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:40.504507 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:54:40.504507 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: warnings.warn(msg) Jan 28 01:54:40.506140 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-6922d0fe-7402-41bf-8a8f-f297a5598c38 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:54:40.506576 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-6922d0fe-7402-41bf-8a8f-f297a5598c38 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:54:40.507350 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-6922d0fe-7402-41bf-8a8f-f297a5598c38 admin admin] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:54:40.507776 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-6922d0fe-7402-41bf-8a8f-f297a5598c38 admin admin] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:54:40.544271 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-6922d0fe-7402-41bf-8a8f-f297a5598c38 admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.175288 Jan 28 01:54:40.544865 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 36/71] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Jan 28 01:54:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:54:41.990791 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:41.992571 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 Jan 28 01:54:41.994012 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 36/72] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:42.202853 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-7685974e-5d9a-4f1f-9de8-d19b84f0d5cd admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:42.204147 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:54:42.204147 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: warnings.warn(msg) Jan 28 01:54:42.205959 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-7685974e-5d9a-4f1f-9de8-d19b84f0d5cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:54:42.206446 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-7685974e-5d9a-4f1f-9de8-d19b84f0d5cd admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:54:42.208502 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-7685974e-5d9a-4f1f-9de8-d19b84f0d5cd admin admin] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:54:42.209045 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-7685974e-5d9a-4f1f-9de8-d19b84f0d5cd admin admin] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:54:42.231396 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-7685974e-5d9a-4f1f-9de8-d19b84f0d5cd admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090772 Jan 28 01:54:42.231998 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 37/73] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Jan 28 01:54:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:54:54.097033 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:54.098368 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Jan 28 01:54:54.098767 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 37/74] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:54:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:54.296464 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-8ad77886-b592-4d67-8679-ebb41a28b6b1 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:54.297638 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:54:54.297638 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: warnings.warn(msg) Jan 28 01:54:54.299138 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-8ad77886-b592-4d67-8679-ebb41a28b6b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:54:54.299568 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-8ad77886-b592-4d67-8679-ebb41a28b6b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:54:54.300782 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-8ad77886-b592-4d67-8679-ebb41a28b6b1 admin admin] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:54:54.301222 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-8ad77886-b592-4d67-8679-ebb41a28b6b1 admin admin] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:54:54.330169 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-8ad77886-b592-4d67-8679-ebb41a28b6b1 admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088037 Jan 28 01:54:54.331602 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 38/75] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Jan 28 01:54:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:54:55.777891 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: DEBUG nova.api.openstack.wsgi [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] Calling method '>' {{(pid=100651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:55.778892 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: INFO nova.api.openstack.requestlog [None req-a96eb191-306a-4c87-a756-46afb9546d74 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jan 28 01:54:55.779302 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: [pid: 100651|app: 0|req: 38/76] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Jan 28 01:54:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:54:55.988094 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG nova.api.openstack.wsgi [None req-2c44361d-ca86-4f04-b430-2914511f8822 admin admin] Calling method '>' {{(pid=100652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:54:55.989613 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:54:55.989613 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: warnings.warn(msg) Jan 28 01:54:55.991208 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-2c44361d-ca86-4f04-b430-2914511f8822 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:54:55.991637 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-2c44361d-ca86-4f04-b430-2914511f8822 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:54:55.992412 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-2c44361d-ca86-4f04-b430-2914511f8822 admin admin] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:54:55.992849 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: DEBUG oslo_concurrency.lockutils [None req-2c44361d-ca86-4f04-b430-2914511f8822 admin admin] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:54:56.015109 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: INFO nova.api.openstack.requestlog [None req-2c44361d-ca86-4f04-b430-2914511f8822 admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093986 Jan 28 01:54:56.015705 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: [pid: 100652|app: 0|req: 39/77] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Jan 28 01:54:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:55:53.196182 dv-cinder-824978-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 28 01:55:53.196722 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: Fri Jan 28 01:55:53 2022 - graceful shutdown triggered... Jan 28 01:55:53.197193 dv-cinder-824978-1-iscsi devstack@n-api.service[100652]: Gracefully killing worker 2 (pid: 100652)... Jan 28 01:55:53.197540 dv-cinder-824978-1-iscsi devstack@n-api.service[100651]: Gracefully killing worker 1 (pid: 100651)... Jan 28 01:55:54.197668 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: worker 1 buried after 1 seconds Jan 28 01:55:54.197668 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: worker 2 buried after 1 seconds Jan 28 01:55:54.197668 dv-cinder-824978-1-iscsi devstack@n-api.service[100650]: goodbye to uWSGI. Jan 28 01:55:54.199257 dv-cinder-824978-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 28 01:55:54.199798 dv-cinder-824978-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 28 01:55:54.202648 dv-cinder-824978-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 01:55:54.212370 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 01:55:54.215031 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:55:54 2022] *** Jan 28 01:55:54.215194 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:55:54.215328 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:55:54.215442 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: nodename: dv-cinder-824978-1-iscsi Jan 28 01:55:54.215552 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: machine: x86_64 Jan 28 01:55:54.215661 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: clock source: unix Jan 28 01:55:54.215778 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: pcre jit disabled Jan 28 01:55:54.215895 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: detected number of CPU cores: 4 Jan 28 01:55:54.216011 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: current working directory: / Jan 28 01:55:54.216146 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:55:54.216146 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: your processes number limit is 47680 Jan 28 01:55:54.216146 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: your memory page size is 4096 bytes Jan 28 01:55:54.216146 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: detected max file descriptor number: 2048 Jan 28 01:55:54.216146 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: lock engine: pthread robust mutexes Jan 28 01:55:54.216500 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: thunder lock: enabled Jan 28 01:55:54.216500 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 01:55:54.216644 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:55:54.262938 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: Python main interpreter initialized at 0x55d0bc9ea9c0 Jan 28 01:55:54.262938 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: python threads support enabled Jan 28 01:55:54.262938 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: your server socket listen backlog is limited to 100 connections Jan 28 01:55:54.262938 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:55:54.263397 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:55:54.263397 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: *** Operational MODE: preforking *** Jan 28 01:55:54.263665 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:55:54.263665 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: spawned uWSGI master process (pid: 115783) Jan 28 01:55:54.264029 dv-cinder-824978-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 01:55:54.264748 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: spawned uWSGI worker 1 (pid: 115797, cores: 1) Jan 28 01:55:54.264907 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: spawned uWSGI worker 2 (pid: 115798, cores: 1) Jan 28 01:55:54.265222 dv-cinder-824978-1-iscsi devstack@n-api.service[115783]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:55:56.161519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:55:56.161519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: from cryptography.utils import int_from_bytes Jan 28 01:55:56.162276 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:55:56.162276 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: from cryptography.utils import int_from_bytes Jan 28 01:55:56.168472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:55:56.168472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: from cryptography.utils import int_from_bytes Jan 28 01:55:56.169167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:55:56.169167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: from cryptography.utils import int_from_bytes Jan 28 01:55:58.898844 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:55:58.899494 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:55:58.899614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:55:58.899909 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:55:58.900420 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:55:58.900824 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.901148 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.901470 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.901730 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:55:58.902104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.902201 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:55:58.902318 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.902400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.902482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:55:58.902703 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.902815 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:55:58.903017 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.903128 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:55:58.903341 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.903445 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.903600 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.903750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.903905 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.904075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.904220 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824978-1-iscsi {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.904398 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.904538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.904732 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.904917 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.905084 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.905177 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.905411 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.905529 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.905734 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.905854 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.906063 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.906166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.906330 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.906487 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.906646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.906849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.906964 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824978-1-iscsi {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.907324 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.908024 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.908349 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.908582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.908689 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.908784 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.908784 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.909088 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.909190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.909284 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.909284 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.909496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.909496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.909750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.909750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910023 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910279 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910370 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910475 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824978-1-iscsi {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910732 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910817 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.910901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.911206 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.911311 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.911528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.911628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.912418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.912418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.912780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.912978 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.913132 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.913286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.913432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.913432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.913745 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824978-1-iscsi {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.913895 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.914046 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.914201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.914347 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.914347 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.914657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.914657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.915032 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.915193 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.915348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.915704 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917011 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917169 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917542 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917639 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.917914 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918017 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918297 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918390 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918533 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918695 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918793 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918884 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.918968 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919059 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919156 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919267 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919365 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919830 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.919929 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920108 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920249 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920388 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920592 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920778 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.920948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.921113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.921113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.921540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.921540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.921909 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.922259 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.922423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.922423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.922785 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.923436 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.923718 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.923718 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.924033 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.924173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.924312 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.924455 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.924604 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.924758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.924892 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.924982 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.925137 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.925226 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.925311 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.925405 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.925490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.925595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.925819 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.925926 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.926068 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.926167 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.926260 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.926353 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.926444 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.926594 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.926694 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.926996 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.927101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.927253 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.927351 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.927565 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.927676 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.927911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.928011 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.928214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.928312 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.928466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.928569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.928767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.928979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.929080 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.929175 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.929400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.929510 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.929713 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.929806 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.930018 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.930113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.930323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.930475 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.930607 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.930695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.930915 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.931014 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.931219 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.931319 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.931524 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.931643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.931823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.931916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.932129 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.932229 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.932432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.932525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.932739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.932866 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.933080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.933180 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.933381 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.933473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.933690 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.933782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.934003 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.934096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.934307 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.934407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.934612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.934712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.934919 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.935012 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.935225 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.935387 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.935535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.935628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.935844 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.935977 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.936152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.936308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.936467 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.936567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.936773 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.936948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.937100 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.937202 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.937411 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.937511 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.937714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.937823 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.938019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.938113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.938336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.938444 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.939242 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.939346 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.939548 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.939639 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.939870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.939966 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.940177 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.940281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.940481 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.940582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.940783 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.940927 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.941109 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.941245 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.941413 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.941575 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.941882 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.941985 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.942184 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.942284 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.942496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.942625 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.942818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.942930 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.943129 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.943249 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.943561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.943882 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.944189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.944319 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.944495 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.944616 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.944984 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.945156 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.945156 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.945445 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.945598 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.945743 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.945921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.946163 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.946334 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.946483 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.946635 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.946780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.948948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.949046 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.949046 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.949193 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.949285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.949372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.949455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.949539 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.949619 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.949699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.949777 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.949861 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:55:58.949941 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950112 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950264 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950344 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950424 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950586 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950742 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950913 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.950991 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951689 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951816 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951907 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.951981 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.952160 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.952259 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.952475 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.952575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.952811 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.952912 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.953154 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.953254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.953488 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.953597 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.953796 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.953891 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.954172 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.954279 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.954568 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.954737 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.954942 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.955095 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.955202 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.955285 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.955522 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.955628 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.955834 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.955936 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.956138 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.956239 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.956481 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.956589 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.956835 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.956972 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.957143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.957250 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.957451 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.957559 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.957761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.957935 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.958098 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.958199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.958369 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.958475 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.958746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.958857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.959012 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.959104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.959307 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.959405 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.959615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.959720 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.959925 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.960028 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.960243 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.960339 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.960554 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.960650 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.960887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.960997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.961196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.961292 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.961507 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.961612 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.961815 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.961910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.962119 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.962222 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.962425 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.962535 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.962776 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.962887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.963047 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.963152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.963423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.963546 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.963692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.963803 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.963952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.964060 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.964366 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.964476 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.964551 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.964630 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.964896 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.965020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.965214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.965310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.965527 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.965687 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.965833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.965987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.966152 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.966296 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.966446 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.966689 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.966849 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.966995 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.967138 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.967289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.967434 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.967670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.967834 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.968062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.968219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.968376 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.968528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.968672 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.969019 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.969181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.969181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.969474 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.969627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.969849 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.970066 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.970302 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.970539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.970742 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.970899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.971054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.971207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.971361 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.971361 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.971643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.971643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.971933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.972085 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.972241 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.972385 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.972528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.972528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.972957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.973112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.973264 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.973433 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.973732 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.973891 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.974045 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.974198 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.974360 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.974688 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.974838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.974991 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.975155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.975300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.975443 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.975593 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.975746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.975898 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.976051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.976194 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.976345 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.976496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.976655 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.976915 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.977066 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.977228 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.977380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.977532 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.977692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.977918 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.978075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.978219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.978363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.978506 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.978657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.978801 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.979099 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.979252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.979407 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.979559 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.979716 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.979860 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.980011 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.980171 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.980324 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.980468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.980619 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.980771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.981006 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.981171 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.981324 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.981479 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.981632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.981777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.981927 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.982072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.982214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.982364 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.982521 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.982674 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.982836 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.982997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.983221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.983394 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.983540 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.983841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.984002 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.984147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.984298 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.984456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.984627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.985078 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.985243 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.985887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.986066 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.986303 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.986559 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.986788 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.987032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.987192 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.987339 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.987493 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.987637 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.987780 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.987939 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.988169 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.988333 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.988487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.988632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.988811 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.988963 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.989269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.989509 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.989656 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.989798 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.989949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.990091 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.990233 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.990384 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.990528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.990670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.990820 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.990974 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.991117 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.991270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.991414 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.991557 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.991698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.991839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.991988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.992140 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.992283 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.992432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.992590 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.992761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.992943 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.993097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.993327 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.993485 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.993639 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.993784 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.994104 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.994254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.994398 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.994548 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.994744 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.994900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.995264 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.995426 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.995570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.995723 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.995867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.996009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.996160 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.996304 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.996454 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.996597 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.996748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.996982 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.997229 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.997489 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.997638 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.997790 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.997934 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.998090 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.998330 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.998489 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.998634 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.998784 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.998928 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.999091 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.999399 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.999550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.999711 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:58.999857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.000063 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.000237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.000393 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.000546 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.000690 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.000862 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.001894 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.002056 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.002252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.002409 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.002567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.002739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.003080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.003242 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.003494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.003652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.003802 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.003961 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.004301 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.004459 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.004620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.004779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.004961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.005126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.005398 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.005660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.005817 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.005977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.006131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.006289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.006448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.006606 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.006863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.007016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.007174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.007599 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.007772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.007932 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.008092 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.008243 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.008486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.008657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.008829 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.008829 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.009142 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.009527 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.009705 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.009873 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.010076 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.010245 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.010397 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.010548 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.010714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.010867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.011024 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.011176 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.011325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.011476 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.011681 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.011846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.012007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.012158 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.012319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.012319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.012625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.012776 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.012961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.013124 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.013275 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.013440 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.013700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.013857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.013857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.014149 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.014490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.014657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.014810 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.014967 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.015127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.015278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.015553 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.015836 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.015994 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.016145 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.016309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.016471 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.016741 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.017073 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.017314 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.017709 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.017893 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.018059 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.018221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.018373 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.018618 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.018785 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.018952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.019105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.019255 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.019405 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.019736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.019895 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.020057 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.020210 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.020368 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.020519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.020677 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.020850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.021025 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.021257 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.021419 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.021581 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.021750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.021904 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.022063 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.022222 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.022374 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.022553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.022833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.023016 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.023178 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.023329 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.023496 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.023675 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.023920 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.024089 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.024248 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.024418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.024742 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.024918 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.025334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.025487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.025487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.025995 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.026168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.026329 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.026482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.026640 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.026812 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.026972 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.026972 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.027279 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.027437 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.027596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.027848 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.028017 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.028183 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.028343 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.028501 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.028741 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.028970 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.029145 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.029298 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.029456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.029607 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.029922 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.030080 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.030247 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.030407 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.030568 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.030727 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.030877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.031034 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.031208 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.031361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.031511 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.031670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.031876 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.032034 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.032717 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.032899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.033155 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.033411 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.033682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.033863 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.034119 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.034296 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.034450 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.034607 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.034937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.035109 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.035269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.035428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.035588 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.035758 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.036028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.036289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.036484 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.036642 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.036856 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.037033 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.037186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.037346 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.037498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.037649 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.037798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.038050 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.038215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.038367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.038524 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.038685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.038930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.039104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.039266 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.039418 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.039567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.039726 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.040052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.040212 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.040373 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.040524 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.040683 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.040857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.041014 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.041164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.041337 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.041497 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.041648 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.041806 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.041957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.042116 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.042276 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.042435 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.042599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.042750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.042901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.043060 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.043226 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.043391 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.043553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.043553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.043838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.043838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.044151 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.044386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.044541 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.044693 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.045092 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.045268 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.045422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.045597 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.045748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.045906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.046190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.046474 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.046633 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.046784 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.046935 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.047087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.047246 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.047397 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.047547 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.047697 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.048498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.048878 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.049308 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.049533 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.049689 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.049848 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.050017 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.050352 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.050519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.050673 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.050831 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.050982 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.051131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.051295 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.051455 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.051614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.051765 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.051923 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.052073 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.052232 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.052385 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.052542 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.052700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.052922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.053089 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.053252 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.053423 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.053577 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.053727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.053877 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.054034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.054196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.054365 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.054602 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.054758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.054917 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.055256 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.055500 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.055674 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.055826 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.055976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.056125 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.056403 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.056682 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.056857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.057025 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.057185 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.057345 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.057505 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.057664 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.057867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.058035 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.058185 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.058334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.058493 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.058829 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.058829 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.059238 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.059238 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.059616 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.059930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.060088 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.060264 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.060532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.060709 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.060896 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.061052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.061202 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.061351 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.061500 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.061657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.061819 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.061970 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.062127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.062127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.062422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.062422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.062738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.062899 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.063058 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.063215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.063379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.063561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.063792 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.063792 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.064289 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.064491 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.064745 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.064960 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.065135 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.065478 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.065635 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.065793 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.065954 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.066115 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.066268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.066443 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.066720 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.066978 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.067134 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.067299 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.067451 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.067620 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.067771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.067929 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.068091 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.068255 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.068415 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.068574 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.068732 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.068910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.069094 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.069334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.069504 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.069746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.069930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.070166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.070337 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.070508 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.070755 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.070911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.071071 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.071224 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.071388 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.071550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.071708 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.071859 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.072029 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.072189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.072356 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.072513 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.072663 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.072832 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.073001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.073167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.073167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.073474 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.073624 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.073774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.073925 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.074094 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.074246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.074404 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.074564 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.074735 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.074989 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.075154 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.075306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.075667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.075834 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.075986 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.076145 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.076310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.076480 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.076639 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.076991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.077268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.077442 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.077596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.077755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.077906 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.078055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.078205 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.078363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.078525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.078689 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.078860 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.079053 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.079213 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.079536 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.079799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.080210 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.080535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.080815 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.080815 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.081364 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.081546 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.081702 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.081865 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.082025 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.082186 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.082345 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.082497 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.082655 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.082808 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.082967 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.083119 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.083269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.083438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.083592 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.083752 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.083916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.084076 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.084235 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.084395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.084546 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.084713 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.084899 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.085216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.085380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.085557 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.085919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.086087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.086250 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.086414 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.086564 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.086714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.086874 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.087166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.087449 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.087615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.087767 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.087926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.088090 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.088242 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.088402 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.088572 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.088734 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.088975 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.089146 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.089307 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.089477 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.089730 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.089886 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.090037 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.090303 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.090469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.090733 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.090899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.091088 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.091330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.091496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.091648 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.091799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.091958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.092118 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.092278 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.092438 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.092590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.092741 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.092927 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.093080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.093396 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.093562 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.093715 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.093873 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.094025 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.094184 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.094349 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.094509 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.095294 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.095521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.095782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.096251 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.096428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.096594 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.096752 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.096930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.097322 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.097509 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.097790 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.097955 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.098108 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.098268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.098420 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.098585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.098737 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.098907 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.099058 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.099209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.099358 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.099519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.099671 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.099932 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.100089 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.100419 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.100576 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.100771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.101005 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.101160 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.101347 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.101585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.101757 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.101910 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.102059 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.102216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.102367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.102525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.102692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.102844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.103002 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.103154 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.103311 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.103480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.103646 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.103809 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.103809 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.104095 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.104246 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.104403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.104564 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.104716 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.104889 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.105054 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.105212 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.105476 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.105657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.105811 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.105968 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.106144 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.106476 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.106645 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.106799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.106950 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.107100 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.107251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.107519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.107692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.107980 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.108147 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.108379 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.108535 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.108696 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.109042 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.109205 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.109356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.109356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.109661 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.109822 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.110076 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.110313 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.111111 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.111361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.111643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.111966 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.112142 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.112344 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.112500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.112658 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.112849 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.113014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.113168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.113339 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.113499 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.113652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.113824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.113985 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.114137 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.114460 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.114620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.114782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.114949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.115102 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.115252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.115410 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.115672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.115913 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.116076 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.116236 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.116406 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.116732 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.116965 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.117133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.117296 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.117455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.117455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.117871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.118162 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.118321 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.118472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.118630 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.118782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.118951 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.118951 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.119266 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.119428 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.119580 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.119730 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.119894 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.120085 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.120333 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.120498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.120651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.120912 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.121105 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.121338 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.121499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.121659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.121812 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.121979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.121979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.122371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.122371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.122371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.122371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.123117 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.123280 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.123431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.123590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.123590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.123887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.124047 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.124199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.124356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.124518 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.124670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.124863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.125034 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.125187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.125337 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.125495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.125664 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.125921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.126096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.126328 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.126602 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.127148 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.127330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.127498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.127660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.127977 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.128267 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.128435 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.128590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.128590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.128914 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.129078 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.129230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.129380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.129542 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.129708 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.129870 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.130022 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.130172 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.130339 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.130577 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.130754 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.130908 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.131059 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.131210 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.131382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.131622 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.131800 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.131954 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.132113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.132113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.132501 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.132664 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.132865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.133110 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.133265 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.133415 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.133565 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.133735 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.133735 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.134046 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.134206 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.134365 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.134524 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.134685 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.134836 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.134994 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.135154 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.135154 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.135450 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.135615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.135775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.136022 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.136196 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.136348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.136508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.136661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.136842 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.139896 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.139896 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.140239 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.140418 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.140608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.141019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.141200 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.141379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.141561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.141974 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.142227 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.142632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.142842 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.142999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.143160 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.143323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.143483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.143643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.143798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.143957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.144132 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.144132 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.144429 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.144582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.144740 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.144932 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.145097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.145257 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.145417 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.145568 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.145721 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.145873 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.146057 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.146309 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.146477 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.146636 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.146797 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.146948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.147354 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.147515 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.147666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.147818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.148052 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.148215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.148367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.148517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.148680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.148680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.149011 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.149172 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.149332 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.149490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.149648 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.149800 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.150440 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.150614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.150775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.151042 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.151212 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.151364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.151528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.151681 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.151849 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.152089 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.152245 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.152406 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.152585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.152868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.152868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.153179 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.153349 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.153520 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.153691 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.153844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.153997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.153997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.154893 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.154893 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.155201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.155362 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.155591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.155752 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.155921 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.156080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.156239 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.156498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.156667 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.156840 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.157010 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.157875 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.158106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.158364 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.158613 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.158858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.159042 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.159198 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.159350 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.159557 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.159714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.159874 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.160026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.160178 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.160349 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.160777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.160974 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.161257 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.161429 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.161582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.161747 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.161900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.162070 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.162070 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.162468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.162620 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.162798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.163061 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.163216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.163368 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.163519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.163691 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.163853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.164020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.164185 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.164345 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.164497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.164657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.164919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.165079 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.165230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.165393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.165553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.165730 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.165881 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.166211 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.166430 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.166799 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.167025 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.167255 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.167469 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.167686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.168134 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.168352 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.168573 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.169008 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.169271 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.169487 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.169703 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.169931 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.170164 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.170392 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.170392 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.171034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.171034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.171229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.171229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.171403 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.171476 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.171868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.171998 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.172126 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.172254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.172439 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.172581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.172679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.172824 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.173483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.173624 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.173750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.173964 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.174140 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.174370 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.174552 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.174685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.174685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.174856 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.174950 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175241 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175326 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175419 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175507 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175579 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175672 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175757 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.175924 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.176082 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.176224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.176340 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.176441 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.176528 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.176612 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.176768 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.176959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177057 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177143 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177228 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:55:59.177322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.177322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.178998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.179706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.179706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.179706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:55:59.179706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:55:59.180025 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_db.sqlalchemy.engines [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:55:59.182209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_db.sqlalchemy.engines [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:55:59.261955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.context [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8452b107-e1f7-4d38-8e73-ac08c235b44e(cell1) {{(pid=115797) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:55:59.266388 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:55:59.268089 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:55:59.268987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:55:59.271026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:55:59.276428 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.context [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8452b107-e1f7-4d38-8e73-ac08c235b44e(cell1) {{(pid=115798) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:55:59.280982 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:55:59.283295 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_db.sqlalchemy.engines [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:55:59.283666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:55:59.284171 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_db.sqlalchemy.engines [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:55:59.286404 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:55:59.287492 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:55:59.299126 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_db.sqlalchemy.engines [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:55:59.300689 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_db.sqlalchemy.engines [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:55:59.558121 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_db.sqlalchemy.engines [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:55:59.578197 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_db.sqlalchemy.engines [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:55:59.896467 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: WARNING keystonemiddleware.auth_token [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:55:59.903695 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: WARNING keystonemiddleware.auth_token [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:55:59.940181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: WARNING keystonemiddleware.auth_token [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:55:59.953182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: WARNING keystonemiddleware.auth_token [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:56:00.269087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: WARNING keystonemiddleware.auth_token [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:56:00.278285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: WARNING keystonemiddleware.auth_token [None req-1b33344c-2650-4a94-80b0-417483ab9b4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:56:00.285186 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0bc9ea9c0 pid: 115797 (default app) Jan 28 01:56:00.358352 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: WARNING keystonemiddleware.auth_token [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:56:00.365702 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: WARNING keystonemiddleware.auth_token [None req-a88425f1-460b-4c3e-8d9a-d21e87b9ab6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:56:00.370915 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0bc9ea9c0 pid: 115798 (default app) Jan 28 01:56:48.934116 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d5e6c8f6-0e91-4511-bda4-c047aeef4a7d tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Action: 'create', calling method: .version_select at 0x7f524526e0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2057162024"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:56:49.340228 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e454baea-6c5a-49de-b710-2bbabb6f1825 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Action: 'create', calling method: .version_select at 0x7f524526f0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1115362735", "metadata": {"Type": "work"}}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:56:51.829911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d5e6c8f6-0e91-4511-bda4-c047aeef4a7d tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.472688 Jan 28 01:56:51.837534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 1/1] 10.222.0.96 () {60 vars in 1154 bytes} [Fri Jan 28 01:56:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4476 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 01:56:51.940186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e454baea-6c5a-49de-b710-2bbabb6f1825 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.301557 Jan 28 01:56:51.947785 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 1/2] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Jan 28 01:56:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4312 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 01:56:52.045107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2093905483", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "72255c1f-77c9-4e8a-9e7a-3b079454c5f0"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:56:52.247051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1225361140", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "6dc19d78-9658-4886-82d7-0e66c7c36321"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:56:52.334907 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] validate_networks() for [('72255c1f-77c9-4e8a-9e7a-3b079454c5f0', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:56:52.486304 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] validate_networks() for [('6dc19d78-9658-4886-82d7-0e66c7c36321', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:56:54.278014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:56:54.279534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:56:54.282279 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:56:54.291054 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:56:54.295167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:56:54.306333 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:56:54.306923 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:56:54.307426 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:56:54.307919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:56:54.309269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:56:54.336284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:54.337131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:54.338442 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:54.339230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:54.345308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:54.346633 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:54.348285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:54.353834 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:54.382678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Getting quotas for project 8c0aef26837b47059522707fb2ce8422. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:56:54.393561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Getting quotas for user d62a8866a5dd404cbc333c640d85e6f2 and project 8c0aef26837b47059522707fb2ce8422. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:56:54.429049 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:56:54.441739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:56:54.448382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Getting quotas for project f2f478fd06754a38b139c8415da6a514. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:56:54.491067 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Getting quotas for user 1f57e62502564821b4be822554d9f5a7 and project f2f478fd06754a38b139c8415da6a514. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:56:54.562688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:56:54.566427 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:56:54.666544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-86eea6db-8cde-4676-b7d5-5131babb331d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.717177 Jan 28 01:56:54.667768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 2/3] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:56:54.677608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cd56410c-66eb-4d1d-9287-10c564a57ef0 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f5244844430>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:54.800724 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-def35a32-f9d3-4ede-a643-ac758354e135 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.968211 Jan 28 01:56:54.807404 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 2/4] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:56:54.816158 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-71bb252b-1168-48c0-adc2-0e7cdba55ac7 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f5244846430>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:54.847961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cd56410c-66eb-4d1d-9287-10c564a57ef0 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908" status: 200 len: 346 microversion: 2.1 time: 0.178599 Jan 28 01:56:54.848690 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 3/5] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:56:54 2022] GET /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908 => generated 346 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:54.853424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8cc6a2c2-b4a8-41e4-a7a7-9f75c0b5771c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:54.854209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8cc6a2c2-b4a8-41e4-a7a7-9f75c0b5771c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:56:55.023152 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-71bb252b-1168-48c0-adc2-0e7cdba55ac7 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 200 len: 354 microversion: 2.1 time: 0.214240 Jan 28 01:56:55.024077 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 3/6] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:56:54 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:55.029977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b161bc26-04bd-47e2-b94f-e2a14f848350 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:55.031885 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b161bc26-04bd-47e2-b94f-e2a14f848350 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:56:55.108744 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8cc6a2c2-b4a8-41e4-a7a7-9f75c0b5771c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:56:55.150624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8cc6a2c2-b4a8-41e4-a7a7-9f75c0b5771c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1215 microversion: 2.1 time: 0.298692 Jan 28 01:56:55.153777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 4/7] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:54 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1215 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:55.169519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b9f3ebd9-1bcf-4e2f-ab8b-21fd0b7808ca tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Action: 'create', calling method: .version_select at 0x7f524485de50>, body: {"snapshot": {"volume_id": "b65aa60f-649c-44f6-94a0-3519da635908", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-875641908"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:56:55.272955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b161bc26-04bd-47e2-b94f-e2a14f848350 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:56:55.303279 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b161bc26-04bd-47e2-b94f-e2a14f848350 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1218 microversion: 2.1 time: 0.277162 Jan 28 01:56:55.309382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 4/8] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:55 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1218 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:55.332058 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0866d17e-f55e-4a10-b754-74c1d360134a tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f5244861e50>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:55.517860 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0866d17e-f55e-4a10-b754-74c1d360134a tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 200 len: 354 microversion: 2.1 time: 0.206813 Jan 28 01:56:55.519163 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 5/9] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:56:55 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:55.537787 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8e5ae1a0-6583-4e3b-b491-df19e010e2f9 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f523ffde310>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:55.595926 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b9f3ebd9-1bcf-4e2f-ab8b-21fd0b7808ca tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.440158 Jan 28 01:56:55.599470 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 5/10] 10.222.0.96 () {60 vars in 1161 bytes} [Fri Jan 28 01:56:55 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:55.626655 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b4a2063f-1f34-45e6-b687-49d5ada112bc tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ffdc550>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:55.654983 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8e5ae1a0-6583-4e3b-b491-df19e010e2f9 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 202 len: 0 microversion: 2.1 time: 0.121847 Jan 28 01:56:55.655767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 6/11] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Jan 28 01:56:55 2022] DELETE /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:56:55.666022 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b533fdea-90d3-4f6a-bc75-199b974c6e01 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f523ffde940>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:55.823272 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b4a2063f-1f34-45e6-b687-49d5ada112bc tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 200 len: 286 microversion: 2.1 time: 0.216793 Jan 28 01:56:55.824252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 6/12] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 01:56:55 2022] GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 286 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:56:55.839081 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b4f4f574-4606-4616-be8f-b51072ab46fe tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ffdc430>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:55.912507 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b533fdea-90d3-4f6a-bc75-199b974c6e01 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 200 len: 353 microversion: 2.1 time: 0.250681 Jan 28 01:56:55.918117 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 7/13] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:56:55 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:56.008824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b4f4f574-4606-4616-be8f-b51072ab46fe tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.176342 Jan 28 01:56:56.009747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 7/14] 10.222.0.96 () {58 vars in 1139 bytes} [Fri Jan 28 01:56:55 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:56:56.022351 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1e5e9206-7c77-4f6e-96dc-db1acee4cb43 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ffdef70>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:56.064957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1e5e9206-7c77-4f6e-96dc-db1acee4cb43 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 200 len: 286 microversion: 2.1 time: 0.046996 Jan 28 01:56:56.069870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 8/15] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 01:56:56 2022] GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:56.178499 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0a0aea70-56e2-45df-ba5f-0e1508b33574 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:56.179359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0a0aea70-56e2-45df-ba5f-0e1508b33574 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:56:56.328367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8bad56be-e978-4487-b686-ce0c21aa6b81 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:56.329689 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8bad56be-e978-4487-b686-ce0c21aa6b81 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:56:56.427496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0a0aea70-56e2-45df-ba5f-0e1508b33574 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:56:56.445680 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0a0aea70-56e2-45df-ba5f-0e1508b33574 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1215 microversion: 2.1 time: 0.272160 Jan 28 01:56:56.456964 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 8/16] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:56 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:56.883822 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8bad56be-e978-4487-b686-ce0c21aa6b81 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:56:56.889604 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8bad56be-e978-4487-b686-ce0c21aa6b81 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1218 microversion: 2.1 time: 0.566574 Jan 28 01:56:56.891010 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 9/17] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:56 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1218 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:56.928584 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5b856279-d254-44b5-b989-55c5650f51b2 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f524485ddc0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:57.080276 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-88c8a862-c66b-4063-83b3-d36c9cfb56fc tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f5244861430>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:57.115834 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5b856279-d254-44b5-b989-55c5650f51b2 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 200 len: 353 microversion: 2.1 time: 0.194052 Jan 28 01:56:57.122335 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 9/18] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:56:56 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 353 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:57.177769 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-88c8a862-c66b-4063-83b3-d36c9cfb56fc tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 200 len: 286 microversion: 2.1 time: 0.102365 Jan 28 01:56:57.179278 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 10/19] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 01:56:57 2022] GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:56:57.469770 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8fd82d7c-7497-4157-b26c-d47cc9b8b6db tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:57.470640 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8fd82d7c-7497-4157-b26c-d47cc9b8b6db tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:56:57.495462 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fd82d7c-7497-4157-b26c-d47cc9b8b6db tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:57.499901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fd82d7c-7497-4157-b26c-d47cc9b8b6db tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:57.507044 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fd82d7c-7497-4157-b26c-d47cc9b8b6db tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:57.507596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fd82d7c-7497-4157-b26c-d47cc9b8b6db tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:57.885513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8fd82d7c-7497-4157-b26c-d47cc9b8b6db tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:56:57.909476 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8fd82d7c-7497-4157-b26c-d47cc9b8b6db tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1219 microversion: 2.1 time: 0.444340 Jan 28 01:56:57.915761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-79fdda39-9cef-45c1-932d-c9bd153158ac tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:57.917268 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-79fdda39-9cef-45c1-932d-c9bd153158ac tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:56:57.923022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 10/20] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:57 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1219 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:57.931371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79fdda39-9cef-45c1-932d-c9bd153158ac tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:57.933014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79fdda39-9cef-45c1-932d-c9bd153158ac tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:57.936500 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79fdda39-9cef-45c1-932d-c9bd153158ac tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:57.937380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79fdda39-9cef-45c1-932d-c9bd153158ac tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:58.253969 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-79fdda39-9cef-45c1-932d-c9bd153158ac tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:56:58.258981 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1812906706", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:56:58.267386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-79fdda39-9cef-45c1-932d-c9bd153158ac tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1222 microversion: 2.1 time: 0.363227 Jan 28 01:56:58.268374 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 11/21] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:57 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1222 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:58.290016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-89e82678-9664-4577-bcbf-540318a98db3 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f523ff50820>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:58.351104 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] validate_networks() for [('8d6f683f-7651-4be4-b337-6c7615d8497b', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:56:58.392493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-89e82678-9664-4577-bcbf-540318a98db3 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 200 len: 353 microversion: 2.1 time: 0.122756 Jan 28 01:56:58.393344 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 12/22] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:56:58 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:58.403437 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a4282965-f41f-4460-8229-232878ab3d78 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ff5b430>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:58.480475 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a4282965-f41f-4460-8229-232878ab3d78 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 200 len: 286 microversion: 2.1 time: 0.071715 Jan 28 01:56:58.486576 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 13/23] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 01:56:58 2022] GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:58.927055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-15156267-70f0-45b0-9957-196925264c31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:58.928062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-15156267-70f0-45b0-9957-196925264c31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:56:58.951021 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-15156267-70f0-45b0-9957-196925264c31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:58.951488 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-15156267-70f0-45b0-9957-196925264c31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:58.952310 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-15156267-70f0-45b0-9957-196925264c31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:58.960475 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-15156267-70f0-45b0-9957-196925264c31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:59.244955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-15156267-70f0-45b0-9957-196925264c31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:56:59.266439 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-15156267-70f0-45b0-9957-196925264c31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1219 microversion: 2.1 time: 0.343166 Jan 28 01:56:59.286106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 14/24] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:58 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1219 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:56:59.292857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-136b0017-3470-44c2-958f-1a29549fd1d5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:59.308649 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-136b0017-3470-44c2-958f-1a29549fd1d5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:56:59.325055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136b0017-3470-44c2-958f-1a29549fd1d5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:59.326096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136b0017-3470-44c2-958f-1a29549fd1d5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:59.327115 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136b0017-3470-44c2-958f-1a29549fd1d5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:59.328365 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136b0017-3470-44c2-958f-1a29549fd1d5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:59.468665 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-136b0017-3470-44c2-958f-1a29549fd1d5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:56:59.481681 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-136b0017-3470-44c2-958f-1a29549fd1d5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1222 microversion: 2.1 time: 0.192952 Jan 28 01:56:59.482507 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 15/25] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:59 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1222 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:56:59.492383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c2f7c374-0a5b-4895-8ee7-d12b33e55a7a tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f523ff7f700>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:59.581831 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:56:59.583332 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:56:59.583849 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:56:59.586107 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:56:59.586652 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:56:59.615841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:59.616468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:59.619298 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:59.621115 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:59.656833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Getting quotas for project d068e263c4ba4c6fa1bc08b5e2c90d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:56:59.663559 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Getting quotas for user 7b8f259580b84c1da7ccd7dd9391e406 and project d068e263c4ba4c6fa1bc08b5e2c90d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:56:59.688008 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:56:59.692947 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:56:59.715364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c2f7c374-0a5b-4895-8ee7-d12b33e55a7a tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 200 len: 353 microversion: 2.1 time: 0.229345 Jan 28 01:56:59.721107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 16/26] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:56:59 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 353 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:59.740210 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6ea915b5-8982-4574-afe4-65af8f10ed37 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ff504c0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:59.821383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6ea915b5-8982-4574-afe4-65af8f10ed37 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 200 len: 286 microversion: 2.1 time: 0.093740 Jan 28 01:56:59.822246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 17/27] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 01:56:59 2022] GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:59.837424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-270623ec-1303-40db-bc60-e96760d829f4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.849004 Jan 28 01:56:59.839997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 11/28] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:56:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:56:59.853458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f815ec44-8b75-4643-a5e3-c0178bbdae0c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:59.854905 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f815ec44-8b75-4643-a5e3-c0178bbdae0c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:00.017726 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f815ec44-8b75-4643-a5e3-c0178bbdae0c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:00.046477 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f815ec44-8b75-4643-a5e3-c0178bbdae0c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1222 microversion: 2.1 time: 0.198231 Jan 28 01:57:00.047638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 18/29] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:56:59 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1222 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:00.226385 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1641622793", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:00.313535 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-426049b1-efef-4d66-8193-4cbae7debb6c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:00.314241 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-426049b1-efef-4d66-8193-4cbae7debb6c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:00.324697 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-426049b1-efef-4d66-8193-4cbae7debb6c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:00.325229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-426049b1-efef-4d66-8193-4cbae7debb6c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:00.334751 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-426049b1-efef-4d66-8193-4cbae7debb6c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:00.335273 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-426049b1-efef-4d66-8193-4cbae7debb6c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:00.340859 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] validate_networks() for [('8d6f683f-7651-4be4-b337-6c7615d8497b', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:57:00.470463 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-426049b1-efef-4d66-8193-4cbae7debb6c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:00.483604 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-426049b1-efef-4d66-8193-4cbae7debb6c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1211 microversion: 2.1 time: 0.183110 Jan 28 01:57:00.496020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 19/30] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:00 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1211 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:00.760680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-48c5f94f-a59a-464d-8cf8-49910d0922ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'create', calling method: .version_select at 0x7f523ffde8b0>, body: {"keypair": {"name": "tempest-keypair-825696241"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:00.834807 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-48c5f94f-a59a-464d-8cf8-49910d0922ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for project c744efbffa214f18ab24d619620343c6. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:57:00.842676 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-48c5f94f-a59a-464d-8cf8-49910d0922ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for user c34c05b7e55447f2a5ddf9c9b9299f44 and project c744efbffa214f18ab24d619620343c6. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:57:01.146269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:57:01.146985 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:57:01.147224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:57:01.147867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:57:01.148501 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:57:01.170578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:01.171407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:01.172632 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:01.173266 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:01.199937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Getting quotas for project d068e263c4ba4c6fa1bc08b5e2c90d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:57:01.215086 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Getting quotas for user 7b8f259580b84c1da7ccd7dd9391e406 and project d068e263c4ba4c6fa1bc08b5e2c90d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:57:01.238092 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:57:01.240976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:57:01.324029 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7f45555a-2bde-40f4-a7c0-d802de7d36f3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.104579 Jan 28 01:57:01.328091 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 12/31] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:57:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:57:01.350278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d7c9a4fa-e3ab-4436-9870-93248c35d9ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:01.351711 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d7c9a4fa-e3ab-4436-9870-93248c35d9ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:01.371373 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d7c9a4fa-e3ab-4436-9870-93248c35d9ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:01.372495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d7c9a4fa-e3ab-4436-9870-93248c35d9ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:01.373007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-48c5f94f-a59a-464d-8cf8-49910d0922ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for project c744efbffa214f18ab24d619620343c6. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:57:01.379650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-48c5f94f-a59a-464d-8cf8-49910d0922ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for user c34c05b7e55447f2a5ddf9c9b9299f44 and project c744efbffa214f18ab24d619620343c6. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:57:01.387118 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d7c9a4fa-e3ab-4436-9870-93248c35d9ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:01.388334 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d7c9a4fa-e3ab-4436-9870-93248c35d9ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:01.409501 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-48c5f94f-a59a-464d-8cf8-49910d0922ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.907313 Jan 28 01:57:01.410394 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 20/32] 10.222.0.96 () {62 vars in 1198 bytes} [Fri Jan 28 01:57:00 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 913 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 01:57:01.430191 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b017177b-ac92-4510-8915-a511ad49a1f4 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f523ff50310>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:01.561496 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b017177b-ac92-4510-8915-a511ad49a1f4 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 200 len: 353 microversion: 2.1 time: 0.148444 Jan 28 01:57:01.567749 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 21/33] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:57:01 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:01.573622 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d4df97e7-8312-46c7-b1cf-f2bc3d2719ef tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523fedb280>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:01.615406 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d7c9a4fa-e3ab-4436-9870-93248c35d9ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:01.624704 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d4df97e7-8312-46c7-b1cf-f2bc3d2719ef tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 200 len: 287 microversion: 2.1 time: 0.055845 Jan 28 01:57:01.626725 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 22/34] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 01:57:01 2022] GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:01.634803 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6d31d25a-11bd-43e6-9b07-c04a8cc84b16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:01.636825 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6d31d25a-11bd-43e6-9b07-c04a8cc84b16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:01.649711 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d7c9a4fa-e3ab-4436-9870-93248c35d9ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1214 microversion: 2.1 time: 0.317557 Jan 28 01:57:01.651768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 13/35] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:01 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1214 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:01.677096 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a025b388-05a8-4538-a9a5-e746f44fc87e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:01.681080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a025b388-05a8-4538-a9a5-e746f44fc87e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:01.697114 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a025b388-05a8-4538-a9a5-e746f44fc87e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:01.717635 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a025b388-05a8-4538-a9a5-e746f44fc87e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:01.718664 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a025b388-05a8-4538-a9a5-e746f44fc87e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:01.719260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a025b388-05a8-4538-a9a5-e746f44fc87e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:01.787977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6d31d25a-11bd-43e6-9b07-c04a8cc84b16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:01.794995 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6d31d25a-11bd-43e6-9b07-c04a8cc84b16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1222 microversion: 2.1 time: 0.166843 Jan 28 01:57:01.795638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 23/36] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:01 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:01.826752 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ff03082f-d7a1-41bd-95af-695a5cd9449f tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ff50700>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:01.962695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a025b388-05a8-4538-a9a5-e746f44fc87e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:01.963467 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ff03082f-d7a1-41bd-95af-695a5cd9449f tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "DELETE /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 202 len: 0 microversion: 2.1 time: 0.151197 Jan 28 01:57:01.964279 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 24/37] 10.222.0.96 () {58 vars in 1253 bytes} [Fri Jan 28 01:57:01 2022] DELETE /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:57:01.973666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-211ce157-c9fa-4ef6-b143-1f47a414583e tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ff2bee0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:01.974700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a025b388-05a8-4538-a9a5-e746f44fc87e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1211 microversion: 2.1 time: 0.319291 Jan 28 01:57:01.975302 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 14/38] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:01 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1211 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:02.074002 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-211ce157-c9fa-4ef6-b143-1f47a414583e tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 200 len: 286 microversion: 2.1 time: 0.104155 Jan 28 01:57:02.079400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 25/39] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 01:57:01 2022] GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:02.592905 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9f20ff66-79a1-461f-8be5-de065365d0bb tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f523ff0b790>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:02.670803 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3900052b-f9c5-48b0-a32d-91a9c55a7db7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:02.673572 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3900052b-f9c5-48b0-a32d-91a9c55a7db7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:02.696700 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3900052b-f9c5-48b0-a32d-91a9c55a7db7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:02.708624 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3900052b-f9c5-48b0-a32d-91a9c55a7db7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:02.709872 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3900052b-f9c5-48b0-a32d-91a9c55a7db7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:02.713706 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3900052b-f9c5-48b0-a32d-91a9c55a7db7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:02.792120 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9f20ff66-79a1-461f-8be5-de065365d0bb tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 200 len: 353 microversion: 2.1 time: 0.221610 Jan 28 01:57:02.792702 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 15/40] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:57:02 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 353 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:02.813912 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ad06fb1e-b47c-457b-a25b-9f4899edba86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:02.814814 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ad06fb1e-b47c-457b-a25b-9f4899edba86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:02.831989 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad06fb1e-b47c-457b-a25b-9f4899edba86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:02.837938 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad06fb1e-b47c-457b-a25b-9f4899edba86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:02.841402 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad06fb1e-b47c-457b-a25b-9f4899edba86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:02.843800 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad06fb1e-b47c-457b-a25b-9f4899edba86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:02.962866 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3900052b-f9c5-48b0-a32d-91a9c55a7db7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:02.978218 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3900052b-f9c5-48b0-a32d-91a9c55a7db7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1214 microversion: 2.1 time: 0.312104 Jan 28 01:57:02.979558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 26/41] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:02 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:03.002414 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-511876df-af3f-417f-84fa-bd27481892f2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:03.003200 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-511876df-af3f-417f-84fa-bd27481892f2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:03.019230 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-511876df-af3f-417f-84fa-bd27481892f2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:03.021186 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-511876df-af3f-417f-84fa-bd27481892f2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:03.025122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-511876df-af3f-417f-84fa-bd27481892f2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:03.026187 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-511876df-af3f-417f-84fa-bd27481892f2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:03.085514 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ad06fb1e-b47c-457b-a25b-9f4899edba86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:03.095670 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ad06fb1e-b47c-457b-a25b-9f4899edba86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1218 microversion: 2.1 time: 0.287409 Jan 28 01:57:03.101722 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 16/42] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:02 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1218 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:03.121761 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ecce517a-33c8-471a-af47-6e333bc43340 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ff5a1f0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:03.208356 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-ecce517a-33c8-471a-af47-6e333bc43340 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] HTTP exception thrown: Snapshot eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 could not be found. Jan 28 01:57:03.211991 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ecce517a-33c8-471a-af47-6e333bc43340 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Returning 404 to user: Snapshot eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:57:03.215853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ecce517a-33c8-471a-af47-6e333bc43340 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06" status: 404 len: 111 microversion: 2.1 time: 0.110200 Jan 28 01:57:03.223275 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 17/43] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 01:57:03 2022] GET /compute/v2.1/os-snapshots/eeea1dad-0b68-4e1f-ab55-7991dc0b2e06 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:57:03.235615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0b6ac3b6-33fc-46dc-93cf-50f6ba148c8a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ff7ae50>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:03.244150 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-511876df-af3f-417f-84fa-bd27481892f2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:03.259678 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-511876df-af3f-417f-84fa-bd27481892f2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1267 microversion: 2.1 time: 0.261406 Jan 28 01:57:03.260293 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 27/44] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:02 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:03.396610 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0b6ac3b6-33fc-46dc-93cf-50f6ba148c8a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908" status: 202 len: 0 microversion: 2.1 time: 0.170264 Jan 28 01:57:03.401837 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 18/45] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Jan 28 01:57:03 2022] DELETE /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:57:03.407804 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0e44bc12-8a8c-4531-a0b1-304ce3970af4 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523fee9f70>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:03.542246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0e44bc12-8a8c-4531-a0b1-304ce3970af4 tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908" status: 200 len: 345 microversion: 2.1 time: 0.138944 Jan 28 01:57:03.543041 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 28/46] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:57:03 2022] GET /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908 => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:57:03.808098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-066fae43-3d39-4f32-a26a-4a24ab20c063 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Calling method '.version_select at 0x7f523ff5a5e0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:03.878699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-066fae43-3d39-4f32-a26a-4a24ab20c063 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] HTTP exception thrown: Volume 1d5e5330-0b2f-4e1e-ab29-19f7178fef57 could not be found. Jan 28 01:57:03.879752 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-066fae43-3d39-4f32-a26a-4a24ab20c063 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] Returning 404 to user: Volume 1d5e5330-0b2f-4e1e-ab29-19f7178fef57 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:57:03.881962 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-066fae43-3d39-4f32-a26a-4a24ab20c063 tempest-VolumesGetTestJSON-814093212 tempest-VolumesGetTestJSON-814093212-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57" status: 404 len: 109 microversion: 2.1 time: 0.079583 Jan 28 01:57:03.886753 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 19/47] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:57:03 2022] GET /compute/v2.1/os-volumes/1d5e5330-0b2f-4e1e-ab29-19f7178fef57 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:57:03.997344 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-610d8536-0bf9-4057-8ae7-3058bfa142eb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:04.004216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-610d8536-0bf9-4057-8ae7-3058bfa142eb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:04.031077 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-610d8536-0bf9-4057-8ae7-3058bfa142eb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:04.032022 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-610d8536-0bf9-4057-8ae7-3058bfa142eb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:04.040357 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-610d8536-0bf9-4057-8ae7-3058bfa142eb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:04.045774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-610d8536-0bf9-4057-8ae7-3058bfa142eb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:04.128647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc0a6efd-aeec-4ff6-b0dd-0360cc2340e1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:04.130005 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc0a6efd-aeec-4ff6-b0dd-0360cc2340e1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:04.195116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc0a6efd-aeec-4ff6-b0dd-0360cc2340e1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:04.199573 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc0a6efd-aeec-4ff6-b0dd-0360cc2340e1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:04.204427 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc0a6efd-aeec-4ff6-b0dd-0360cc2340e1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:04.210203 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc0a6efd-aeec-4ff6-b0dd-0360cc2340e1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:04.531686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-610d8536-0bf9-4057-8ae7-3058bfa142eb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:04.558651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-610d8536-0bf9-4057-8ae7-3058bfa142eb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1270 microversion: 2.1 time: 0.547257 Jan 28 01:57:04.559956 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 29/48] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:03 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1270 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:04.565318 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-79106bbb-b5c3-4907-81e9-fa62253c9514 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:04.569459 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-79106bbb-b5c3-4907-81e9-fa62253c9514 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:04.615269 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79106bbb-b5c3-4907-81e9-fa62253c9514 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:04.617637 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79106bbb-b5c3-4907-81e9-fa62253c9514 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:04.630945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79106bbb-b5c3-4907-81e9-fa62253c9514 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:04.635867 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79106bbb-b5c3-4907-81e9-fa62253c9514 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:05.164185 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bc0a6efd-aeec-4ff6-b0dd-0360cc2340e1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:05.182281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc0a6efd-aeec-4ff6-b0dd-0360cc2340e1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1274 microversion: 2.1 time: 1.058578 Jan 28 01:57:05.183511 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 20/49] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:04 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1274 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:05.218672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eb5aab1a-5d56-4068-adaa-16532fce4e6a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523ff0b820>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:05.314734 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-eb5aab1a-5d56-4068-adaa-16532fce4e6a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] HTTP exception thrown: Volume b65aa60f-649c-44f6-94a0-3519da635908 could not be found. Jan 28 01:57:05.315909 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eb5aab1a-5d56-4068-adaa-16532fce4e6a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Returning 404 to user: Volume b65aa60f-649c-44f6-94a0-3519da635908 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:57:05.317634 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-eb5aab1a-5d56-4068-adaa-16532fce4e6a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908" status: 404 len: 109 microversion: 2.1 time: 0.119357 Jan 28 01:57:05.318916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 21/50] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:57:05 2022] GET /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:57:05.335735 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4482b7a8-9811-4987-b448-e2b7f357abea tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523fec6a60>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:05.352081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-79106bbb-b5c3-4907-81e9-fa62253c9514 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:05.363855 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-79106bbb-b5c3-4907-81e9-fa62253c9514 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1273 microversion: 2.1 time: 0.802477 Jan 28 01:57:05.366630 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 30/51] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:04 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1273 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:05.413653 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-4482b7a8-9811-4987-b448-e2b7f357abea tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] HTTP exception thrown: Volume b65aa60f-649c-44f6-94a0-3519da635908 could not be found. Jan 28 01:57:05.414346 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4482b7a8-9811-4987-b448-e2b7f357abea tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Returning 404 to user: Volume b65aa60f-649c-44f6-94a0-3519da635908 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:57:05.415348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4482b7a8-9811-4987-b448-e2b7f357abea tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908" status: 404 len: 109 microversion: 2.1 time: 0.085223 Jan 28 01:57:05.415847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 22/52] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Jan 28 01:57:05 2022] DELETE /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:57:05.425837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fda5d56c-d1e9-4dee-b325-d28cf5e2cc4a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Calling method '.version_select at 0x7f523f6911f0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:05.507811 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-fda5d56c-d1e9-4dee-b325-d28cf5e2cc4a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] HTTP exception thrown: Volume b65aa60f-649c-44f6-94a0-3519da635908 could not be found. Jan 28 01:57:05.508641 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fda5d56c-d1e9-4dee-b325-d28cf5e2cc4a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] Returning 404 to user: Volume b65aa60f-649c-44f6-94a0-3519da635908 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:57:05.509530 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fda5d56c-d1e9-4dee-b325-d28cf5e2cc4a tempest-VolumesSnapshotsTestJSON-889814497 tempest-VolumesSnapshotsTestJSON-889814497-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908" status: 404 len: 109 microversion: 2.1 time: 0.089390 Jan 28 01:57:05.513266 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 31/53] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 01:57:05 2022] GET /compute/v2.1/os-volumes/b65aa60f-649c-44f6-94a0-3519da635908 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:57:05.583087 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a40e04c5-de9a-4ef3-b2cb-dced6ccc1edd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:05.584082 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a40e04c5-de9a-4ef3-b2cb-dced6ccc1edd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:05.606271 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a40e04c5-de9a-4ef3-b2cb-dced6ccc1edd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:05.606738 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a40e04c5-de9a-4ef3-b2cb-dced6ccc1edd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:05.607744 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a40e04c5-de9a-4ef3-b2cb-dced6ccc1edd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:05.608452 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a40e04c5-de9a-4ef3-b2cb-dced6ccc1edd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:06.158661 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a40e04c5-de9a-4ef3-b2cb-dced6ccc1edd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:06.172621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a40e04c5-de9a-4ef3-b2cb-dced6ccc1edd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1276 microversion: 2.1 time: 0.596689 Jan 28 01:57:06.179266 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 23/54] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:05 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1276 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:06.201916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-de916873-b29c-48d1-a3da-e4ccf7b720d2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:06.203847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-de916873-b29c-48d1-a3da-e4ccf7b720d2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:06.213584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de916873-b29c-48d1-a3da-e4ccf7b720d2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:06.214139 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de916873-b29c-48d1-a3da-e4ccf7b720d2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:06.214832 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de916873-b29c-48d1-a3da-e4ccf7b720d2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:06.221271 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de916873-b29c-48d1-a3da-e4ccf7b720d2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:06.384075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a30a7804-9339-4bb5-8f9e-8f3e5a0586f0 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:06.384923 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a30a7804-9339-4bb5-8f9e-8f3e5a0586f0 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:06.392712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a30a7804-9339-4bb5-8f9e-8f3e5a0586f0 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:06.393643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a30a7804-9339-4bb5-8f9e-8f3e5a0586f0 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:06.394694 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a30a7804-9339-4bb5-8f9e-8f3e5a0586f0 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:06.395413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a30a7804-9339-4bb5-8f9e-8f3e5a0586f0 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:06.447468 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-de916873-b29c-48d1-a3da-e4ccf7b720d2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:06.474887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-de916873-b29c-48d1-a3da-e4ccf7b720d2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1280 microversion: 2.1 time: 0.275026 Jan 28 01:57:06.489747 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 32/55] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:06 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:06.643150 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a30a7804-9339-4bb5-8f9e-8f3e5a0586f0 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:06.653260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a30a7804-9339-4bb5-8f9e-8f3e5a0586f0 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1273 microversion: 2.1 time: 0.273092 Jan 28 01:57:06.661785 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 24/56] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:06 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:06.865991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-714736814", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "828bafe9-6988-48d7-866b-8d25ce9d4df3"}], "security_groups": [{"name": "tempest-securitygroup--1820600036"}], "key_name": "tempest-keypair-825696241", "user_data": "}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:07.148612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] validate_networks() for [('828bafe9-6988-48d7-866b-8d25ce9d4df3', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:57:07.201035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-68afb077-a3f0-4d40-92d1-bfc04fcf70ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:07.203263 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-68afb077-a3f0-4d40-92d1-bfc04fcf70ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:07.221863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68afb077-a3f0-4d40-92d1-bfc04fcf70ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:07.223802 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68afb077-a3f0-4d40-92d1-bfc04fcf70ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:07.227583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68afb077-a3f0-4d40-92d1-bfc04fcf70ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:07.228237 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68afb077-a3f0-4d40-92d1-bfc04fcf70ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:07.408902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-68afb077-a3f0-4d40-92d1-bfc04fcf70ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:07.431892 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-68afb077-a3f0-4d40-92d1-bfc04fcf70ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1276 microversion: 2.1 time: 0.236869 Jan 28 01:57:07.440486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 25/57] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:07 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:07.511062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9c057ee5-ebab-4b29-8574-29870fe77614 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:07.511640 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9c057ee5-ebab-4b29-8574-29870fe77614 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:07.522764 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c057ee5-ebab-4b29-8574-29870fe77614 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:07.523228 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c057ee5-ebab-4b29-8574-29870fe77614 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:07.524040 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c057ee5-ebab-4b29-8574-29870fe77614 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:07.524626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c057ee5-ebab-4b29-8574-29870fe77614 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:07.643896 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9c057ee5-ebab-4b29-8574-29870fe77614 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:07.653630 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9c057ee5-ebab-4b29-8574-29870fe77614 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1280 microversion: 2.1 time: 0.147047 Jan 28 01:57:07.654553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 26/58] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:07 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:07.680867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7c85e540-ad84-4fcd-acf8-80cb4e8dd3b2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:07.681817 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7c85e540-ad84-4fcd-acf8-80cb4e8dd3b2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:07.690855 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c85e540-ad84-4fcd-acf8-80cb4e8dd3b2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:07.691523 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c85e540-ad84-4fcd-acf8-80cb4e8dd3b2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:07.693326 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c85e540-ad84-4fcd-acf8-80cb4e8dd3b2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:07.694498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c85e540-ad84-4fcd-acf8-80cb4e8dd3b2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:08.120192 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7c85e540-ad84-4fcd-acf8-80cb4e8dd3b2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:08.141431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7c85e540-ad84-4fcd-acf8-80cb4e8dd3b2 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.464109 Jan 28 01:57:08.142026 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 27/59] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:07 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:08.221135 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:57:08.221916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:57:08.222061 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:57:08.222455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:57:08.222866 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:57:08.231875 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:08.232421 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:08.233470 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:08.234762 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:08.252975 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for project c744efbffa214f18ab24d619620343c6. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:57:08.259234 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for user c34c05b7e55447f2a5ddf9c9b9299f44 and project c744efbffa214f18ab24d619620343c6. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:57:08.273622 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:57:08.277054 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:57:08.372213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c4d27098-1d19-404d-aaf2-21eed7b245cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.512542 Jan 28 01:57:08.373078 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 33/60] 10.222.0.96 () {62 vars in 1187 bytes} [Fri Jan 28 01:57:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 01:57:08.385230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0228ac40-9de2-4e62-bec3-dddd0c0c3d9a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:08.386763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0228ac40-9de2-4e62-bec3-dddd0c0c3d9a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:08.457695 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-35d076b4-c562-4333-9246-4e6cf6ae3445 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:08.468010 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-35d076b4-c562-4333-9246-4e6cf6ae3445 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:08.491779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35d076b4-c562-4333-9246-4e6cf6ae3445 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:08.492268 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35d076b4-c562-4333-9246-4e6cf6ae3445 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:08.493266 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35d076b4-c562-4333-9246-4e6cf6ae3445 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:08.493805 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35d076b4-c562-4333-9246-4e6cf6ae3445 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:08.546976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0228ac40-9de2-4e62-bec3-dddd0c0c3d9a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:08.557984 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0228ac40-9de2-4e62-bec3-dddd0c0c3d9a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:08.559004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0228ac40-9de2-4e62-bec3-dddd0c0c3d9a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:08.560164 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0228ac40-9de2-4e62-bec3-dddd0c0c3d9a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1280 microversion: 2.20 time: 0.179436 Jan 28 01:57:08.566213 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 28/61] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:08 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:08.670915 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-35d076b4-c562-4333-9246-4e6cf6ae3445 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:08.681291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ab0472fa-1bb9-42dd-8b79-c4b5bca73659 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:08.682389 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ab0472fa-1bb9-42dd-8b79-c4b5bca73659 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:08.687475 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-35d076b4-c562-4333-9246-4e6cf6ae3445 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1276 microversion: 2.1 time: 0.235780 Jan 28 01:57:08.688871 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 34/62] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:08 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:08.708055 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab0472fa-1bb9-42dd-8b79-c4b5bca73659 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:08.708526 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab0472fa-1bb9-42dd-8b79-c4b5bca73659 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:08.711426 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab0472fa-1bb9-42dd-8b79-c4b5bca73659 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:08.713815 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab0472fa-1bb9-42dd-8b79-c4b5bca73659 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:09.042014 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ab0472fa-1bb9-42dd-8b79-c4b5bca73659 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:09.059881 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ab0472fa-1bb9-42dd-8b79-c4b5bca73659 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1280 microversion: 2.1 time: 0.386615 Jan 28 01:57:09.062945 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 29/63] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:08 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:09.160894 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-93b845ec-311c-44eb-9684-1129711f0054 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:09.162045 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-93b845ec-311c-44eb-9684-1129711f0054 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:09.172478 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93b845ec-311c-44eb-9684-1129711f0054 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:09.174426 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93b845ec-311c-44eb-9684-1129711f0054 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:09.175701 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93b845ec-311c-44eb-9684-1129711f0054 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:09.176363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93b845ec-311c-44eb-9684-1129711f0054 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:09.581112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:09.583468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:09.598119 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:09.602771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:09.605361 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:09.608455 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:09.617190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-93b845ec-311c-44eb-9684-1129711f0054 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:09.632483 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-93b845ec-311c-44eb-9684-1129711f0054 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.474612 Jan 28 01:57:09.635758 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 35/64] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:09 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:09.705312 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9e815fe6-bf23-4518-9c8a-5bcba2a06bc9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:09.706192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9e815fe6-bf23-4518-9c8a-5bcba2a06bc9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:09.723771 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e815fe6-bf23-4518-9c8a-5bcba2a06bc9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:09.724298 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e815fe6-bf23-4518-9c8a-5bcba2a06bc9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:09.726685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e815fe6-bf23-4518-9c8a-5bcba2a06bc9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:09.727160 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e815fe6-bf23-4518-9c8a-5bcba2a06bc9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:09.879336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9e815fe6-bf23-4518-9c8a-5bcba2a06bc9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:09.891942 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9e815fe6-bf23-4518-9c8a-5bcba2a06bc9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1276 microversion: 2.1 time: 0.190870 Jan 28 01:57:09.896128 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 36/65] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:09 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:09.906508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:09.923643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:09.934663 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:09.940268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7584edce-2e06-4bf8-815b-cf8df19d3789 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1284 microversion: 2.20 time: 0.363584 Jan 28 01:57:09.963376 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 30/66] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:09 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1284 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:10.089128 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bf2ebc81-52cb-4174-9383-fe5ca1e970f7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:10.090117 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bf2ebc81-52cb-4174-9383-fe5ca1e970f7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:10.098571 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2ebc81-52cb-4174-9383-fe5ca1e970f7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:10.102973 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2ebc81-52cb-4174-9383-fe5ca1e970f7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:10.104046 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2ebc81-52cb-4174-9383-fe5ca1e970f7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:10.104614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2ebc81-52cb-4174-9383-fe5ca1e970f7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:10.321238 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bf2ebc81-52cb-4174-9383-fe5ca1e970f7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:10.330913 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bf2ebc81-52cb-4174-9383-fe5ca1e970f7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1280 microversion: 2.1 time: 0.245482 Jan 28 01:57:10.337086 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 37/67] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:10 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:10.660981 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5ce3dbb6-dc89-4c51-bec3-b23faed87a90 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:10.662558 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5ce3dbb6-dc89-4c51-bec3-b23faed87a90 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:10.673144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ce3dbb6-dc89-4c51-bec3-b23faed87a90 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:10.673850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ce3dbb6-dc89-4c51-bec3-b23faed87a90 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:10.675508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ce3dbb6-dc89-4c51-bec3-b23faed87a90 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:10.676340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ce3dbb6-dc89-4c51-bec3-b23faed87a90 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:10.917390 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3196abca-19fc-4abc-bad8-1b9cece36b72 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:10.918046 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3196abca-19fc-4abc-bad8-1b9cece36b72 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:10.943006 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3196abca-19fc-4abc-bad8-1b9cece36b72 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:10.944215 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3196abca-19fc-4abc-bad8-1b9cece36b72 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:10.945910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3196abca-19fc-4abc-bad8-1b9cece36b72 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:10.946688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3196abca-19fc-4abc-bad8-1b9cece36b72 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:11.843627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5ce3dbb6-dc89-4c51-bec3-b23faed87a90 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:11.853916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5ce3dbb6-dc89-4c51-bec3-b23faed87a90 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 1.204588 Jan 28 01:57:11.854515 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 31/68] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:10 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:11.871251 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:11.872363 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:11.889567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:11.890780 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:11.891737 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:11.892335 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:12.030498 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3196abca-19fc-4abc-bad8-1b9cece36b72 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:12.038571 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3196abca-19fc-4abc-bad8-1b9cece36b72 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 1.126692 Jan 28 01:57:12.052285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 38/69] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:10 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:12.069669 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3a1381e5-385e-4a7c-a4f9-7a8ed7edaf37 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:12.071565 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3a1381e5-385e-4a7c-a4f9-7a8ed7edaf37 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:12.087601 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a1381e5-385e-4a7c-a4f9-7a8ed7edaf37 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:12.089807 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a1381e5-385e-4a7c-a4f9-7a8ed7edaf37 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:12.096002 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a1381e5-385e-4a7c-a4f9-7a8ed7edaf37 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:12.098107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a1381e5-385e-4a7c-a4f9-7a8ed7edaf37 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:12.263260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:12.273489 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:12.282280 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:12.286504 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-69afc5b1-cd5e-4d5b-b903-85e2e4ba9021 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1338 microversion: 2.20 time: 0.420463 Jan 28 01:57:12.297275 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 32/70] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:11 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1338 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:12.691084 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3a1381e5-385e-4a7c-a4f9-7a8ed7edaf37 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:12.709039 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3a1381e5-385e-4a7c-a4f9-7a8ed7edaf37 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.643043 Jan 28 01:57:12.719670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 39/71] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:12 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:12.879041 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bdfeefef-6518-4d27-9e0e-48525175ca21 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:12.880883 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bdfeefef-6518-4d27-9e0e-48525175ca21 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:12.897498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bdfeefef-6518-4d27-9e0e-48525175ca21 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:12.901553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bdfeefef-6518-4d27-9e0e-48525175ca21 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:12.903381 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bdfeefef-6518-4d27-9e0e-48525175ca21 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:12.906083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bdfeefef-6518-4d27-9e0e-48525175ca21 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.062113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-60524cfd-7506-418f-937f-c61580969a32 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:13.063159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-60524cfd-7506-418f-937f-c61580969a32 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:13.075481 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60524cfd-7506-418f-937f-c61580969a32 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.076410 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60524cfd-7506-418f-937f-c61580969a32 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.077519 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60524cfd-7506-418f-937f-c61580969a32 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.078166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60524cfd-7506-418f-937f-c61580969a32 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.339847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bdfeefef-6518-4d27-9e0e-48525175ca21 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:13.348254 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bdfeefef-6518-4d27-9e0e-48525175ca21 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.480591 Jan 28 01:57:13.357431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 33/72] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:12 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:13.377131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:13.377774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:13.391368 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.392045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.392882 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.393596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.535482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:13.543376 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:13.544903 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:13.546577 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8301aee3-d56c-4341-a3e5-c9f01fca911c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1338 microversion: 2.20 time: 0.195425 Jan 28 01:57:13.547147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 34/73] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:13 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1338 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:13.582905 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-60524cfd-7506-418f-937f-c61580969a32 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:13.591701 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-60524cfd-7506-418f-937f-c61580969a32 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.537183 Jan 28 01:57:13.592292 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 40/74] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:13 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:13.614572 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-c3e0ebf4-90f6-48b8-8dc7-8c479449a732 req-897efd24-1f9e-4dd9-b5da-88296d9ce499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d2d895-fbb9-418c-a29a-6988b3992d10", "tag": "1139f116-1935-408c-a5bf-876a9f0d0365"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:13.616909 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:13.616909 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:57:13.627468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-c3e0ebf4-90f6-48b8-8dc7-8c479449a732 req-897efd24-1f9e-4dd9-b5da-88296d9ce499 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.628039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-c3e0ebf4-90f6-48b8-8dc7-8c479449a732 req-897efd24-1f9e-4dd9-b5da-88296d9ce499 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.648240 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-c3e0ebf4-90f6-48b8-8dc7-8c479449a732 req-897efd24-1f9e-4dd9-b5da-88296d9ce499 service nova] Creating event network-changed:1139f116-1935-408c-a5bf-876a9f0d0365 for instance c4d2d895-fbb9-418c-a29a-6988b3992d10 on hv-cinder-82497 Jan 28 01:57:13.648672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-c3e0ebf4-90f6-48b8-8dc7-8c479449a732 req-897efd24-1f9e-4dd9-b5da-88296d9ce499 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 28 01:57:13.649958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a05c7f8b-3be2-406f-8142-40f1b4e3acb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.650658 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a05c7f8b-3be2-406f-8142-40f1b4e3acb0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.651614 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a05c7f8b-3be2-406f-8142-40f1b4e3acb0 None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.652094 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a05c7f8b-3be2-406f-8142-40f1b4e3acb0 None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.659373 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-b4dd8e30-2833-4c0e-9b6a-a9b9d9db16f7 req-9053bcee-2509-45bf-b567-5f67b82bc052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a93ca8fd-3477-43fa-9d41-56e66cb51528", "tag": "e841332d-7cf8-4dbd-bfef-9a71a9c23148"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:13.662256 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:13.662256 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 01:57:13.663516 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.compute.rpcapi [None req-a05c7f8b-3be2-406f-8142-40f1b4e3acb0 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 01:57:13.664406 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a05c7f8b-3be2-406f-8142-40f1b4e3acb0 None None] Releasing lock "compute-rpcapi-router" {{(pid=115798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 28 01:57:13.675015 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-b4dd8e30-2833-4c0e-9b6a-a9b9d9db16f7 req-9053bcee-2509-45bf-b567-5f67b82bc052 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.675521 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-b4dd8e30-2833-4c0e-9b6a-a9b9d9db16f7 req-9053bcee-2509-45bf-b567-5f67b82bc052 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.682613 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a05c7f8b-3be2-406f-8142-40f1b4e3acb0 None None] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134088 Jan 28 01:57:13.683213 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 35/75] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:13.699326 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-b4dd8e30-2833-4c0e-9b6a-a9b9d9db16f7 req-9053bcee-2509-45bf-b567-5f67b82bc052 service nova] Creating event network-changed:e841332d-7cf8-4dbd-bfef-9a71a9c23148 for instance a93ca8fd-3477-43fa-9d41-56e66cb51528 on hv-cinder-82497 Jan 28 01:57:13.699959 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-b4dd8e30-2833-4c0e-9b6a-a9b9d9db16f7 req-9053bcee-2509-45bf-b567-5f67b82bc052 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 28 01:57:13.701164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00b92950-7e75-4baf-bc7e-6214d12ee047 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.701676 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00b92950-7e75-4baf-bc7e-6214d12ee047 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.703014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00b92950-7e75-4baf-bc7e-6214d12ee047 None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.703447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00b92950-7e75-4baf-bc7e-6214d12ee047 None None] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.712393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.compute.rpcapi [None req-00b92950-7e75-4baf-bc7e-6214d12ee047 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 01:57:13.713294 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00b92950-7e75-4baf-bc7e-6214d12ee047 None None] Releasing lock "compute-rpcapi-router" {{(pid=115797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 28 01:57:13.729101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-00b92950-7e75-4baf-bc7e-6214d12ee047 None None] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134719 Jan 28 01:57:13.729748 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 41/76] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:13.730896 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dccfebed-ba48-4b3e-bc85-3ff0ec3a8feb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:13.731608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dccfebed-ba48-4b3e-bc85-3ff0ec3a8feb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:13.739432 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dccfebed-ba48-4b3e-bc85-3ff0ec3a8feb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.739894 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dccfebed-ba48-4b3e-bc85-3ff0ec3a8feb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.740679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dccfebed-ba48-4b3e-bc85-3ff0ec3a8feb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:13.741148 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dccfebed-ba48-4b3e-bc85-3ff0ec3a8feb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:13.866670 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dccfebed-ba48-4b3e-bc85-3ff0ec3a8feb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:13.874528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dccfebed-ba48-4b3e-bc85-3ff0ec3a8feb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.150094 Jan 28 01:57:13.875359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 36/77] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:13 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:14.366700 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b9995358-8d8c-4bda-a7b0-fd32c478ffb3 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:14.367443 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b9995358-8d8c-4bda-a7b0-fd32c478ffb3 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:14.373775 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b9995358-8d8c-4bda-a7b0-fd32c478ffb3 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:14.374831 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b9995358-8d8c-4bda-a7b0-fd32c478ffb3 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:14.376083 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b9995358-8d8c-4bda-a7b0-fd32c478ffb3 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:14.376532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b9995358-8d8c-4bda-a7b0-fd32c478ffb3 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:14.506711 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b9995358-8d8c-4bda-a7b0-fd32c478ffb3 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:14.515376 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b9995358-8d8c-4bda-a7b0-fd32c478ffb3 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.152828 Jan 28 01:57:14.515944 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 42/78] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:14 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:14.567404 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:14.568013 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:14.573944 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:14.574422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:14.575207 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:14.575642 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:14.608154 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-84935597-08f8-4327-b454-de933d40abea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:14.608941 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-84935597-08f8-4327-b454-de933d40abea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:14.615313 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-84935597-08f8-4327-b454-de933d40abea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:14.615951 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-84935597-08f8-4327-b454-de933d40abea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:14.616730 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-84935597-08f8-4327-b454-de933d40abea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:14.617174 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-84935597-08f8-4327-b454-de933d40abea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:14.638482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:14.649405 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:14.651154 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:14.652250 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-86604a67-f99d-43f7-bdea-5dfab4d41fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1338 microversion: 2.20 time: 0.088674 Jan 28 01:57:14.652831 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 37/79] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:14 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1338 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:14.741839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-84935597-08f8-4327-b454-de933d40abea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:14.749954 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-84935597-08f8-4327-b454-de933d40abea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.144643 Jan 28 01:57:14.750466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 43/80] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:14 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:14.891838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c6bbd156-d9c2-408a-aea3-029bc738827b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:14.892486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c6bbd156-d9c2-408a-aea3-029bc738827b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:14.901593 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c6bbd156-d9c2-408a-aea3-029bc738827b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:14.902060 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c6bbd156-d9c2-408a-aea3-029bc738827b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:14.902941 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c6bbd156-d9c2-408a-aea3-029bc738827b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:14.903395 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c6bbd156-d9c2-408a-aea3-029bc738827b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:15.053700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c6bbd156-d9c2-408a-aea3-029bc738827b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:15.062771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c6bbd156-d9c2-408a-aea3-029bc738827b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.173941 Jan 28 01:57:15.063941 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 38/81] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:14 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:15.534227 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9dba73d9-f483-46f7-837b-fc33f50bda81 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:15.534685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9dba73d9-f483-46f7-837b-fc33f50bda81 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:15.557336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dba73d9-f483-46f7-837b-fc33f50bda81 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:15.557336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dba73d9-f483-46f7-837b-fc33f50bda81 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:15.558987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dba73d9-f483-46f7-837b-fc33f50bda81 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:15.559675 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dba73d9-f483-46f7-837b-fc33f50bda81 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:15.670405 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:15.671879 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:15.682624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:15.684351 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:15.687504 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:15.688220 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:15.972378 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:15.981419 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:15.983713 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:15.985633 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-73e2c302-3fb9-4e40-bf0e-6baf2282fda9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1338 microversion: 2.20 time: 0.319070 Jan 28 01:57:15.997431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 39/82] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:15 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1338 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:15.997967 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9dba73d9-f483-46f7-837b-fc33f50bda81 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:16.007698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-98db73eb-1b3b-499d-b3b6-08bd077e3cfa req-c64708c9-2527-4a53-a5b9-33a7a96d7f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5194c2-f570-4463-8a44-765cf06f1206", "tag": "cd5708fe-d124-49c1-b391-fcbc90e2b0d8"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:16.008660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9dba73d9-f483-46f7-837b-fc33f50bda81 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.480434 Jan 28 01:57:16.009352 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 44/83] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:15 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:16.010781 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:16.010781 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:57:16.018967 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6df26c05-cf93-41ff-beb8-a5d239019ba3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:16.019588 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6df26c05-cf93-41ff-beb8-a5d239019ba3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:16.020601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-98db73eb-1b3b-499d-b3b6-08bd077e3cfa req-c64708c9-2527-4a53-a5b9-33a7a96d7f01 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:16.021171 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-98db73eb-1b3b-499d-b3b6-08bd077e3cfa req-c64708c9-2527-4a53-a5b9-33a7a96d7f01 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:16.032235 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6df26c05-cf93-41ff-beb8-a5d239019ba3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:16.032766 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6df26c05-cf93-41ff-beb8-a5d239019ba3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:16.033598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6df26c05-cf93-41ff-beb8-a5d239019ba3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:16.034038 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6df26c05-cf93-41ff-beb8-a5d239019ba3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:16.041478 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-98db73eb-1b3b-499d-b3b6-08bd077e3cfa req-c64708c9-2527-4a53-a5b9-33a7a96d7f01 service nova] Creating event network-changed:cd5708fe-d124-49c1-b391-fcbc90e2b0d8 for instance 6e5194c2-f570-4463-8a44-765cf06f1206 on hv-cinder-82497 Jan 28 01:57:16.067042 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-98db73eb-1b3b-499d-b3b6-08bd077e3cfa req-c64708c9-2527-4a53-a5b9-33a7a96d7f01 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063539 Jan 28 01:57:16.068596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 40/84] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:16.087044 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-70a6aeae-f7c5-477a-b0ad-e8ada007e9e0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:16.087757 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-70a6aeae-f7c5-477a-b0ad-e8ada007e9e0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:16.096468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70a6aeae-f7c5-477a-b0ad-e8ada007e9e0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:16.096971 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70a6aeae-f7c5-477a-b0ad-e8ada007e9e0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:16.097759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70a6aeae-f7c5-477a-b0ad-e8ada007e9e0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:16.098406 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70a6aeae-f7c5-477a-b0ad-e8ada007e9e0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:16.241280 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6df26c05-cf93-41ff-beb8-a5d239019ba3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:16.253197 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6df26c05-cf93-41ff-beb8-a5d239019ba3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.237937 Jan 28 01:57:16.257507 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 45/85] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:16 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:16.363514 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-70a6aeae-f7c5-477a-b0ad-e8ada007e9e0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:16.378421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-70a6aeae-f7c5-477a-b0ad-e8ada007e9e0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.301213 Jan 28 01:57:16.396250 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 41/86] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:16 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:17.010411 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:17.013229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:17.026934 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cc2a1247-fdd9-4976-a32e-4345eb6397a6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:17.027620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cc2a1247-fdd9-4976-a32e-4345eb6397a6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:17.037308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:17.041698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc2a1247-fdd9-4976-a32e-4345eb6397a6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:17.045477 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc2a1247-fdd9-4976-a32e-4345eb6397a6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:17.047488 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc2a1247-fdd9-4976-a32e-4345eb6397a6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:17.048210 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc2a1247-fdd9-4976-a32e-4345eb6397a6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:17.053406 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:17.065907 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:17.066367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:17.296990 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:17.304662 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:17.306205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:17.307325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-60240df9-690d-4696-8ff5-b745fb16c02e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1338 microversion: 2.20 time: 0.306331 Jan 28 01:57:17.307889 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 46/87] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:16 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1338 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:17.312244 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-49770bb6-ff4a-48fb-bbd0-ee77ad94445f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:17.313102 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-49770bb6-ff4a-48fb-bbd0-ee77ad94445f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:17.318950 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49770bb6-ff4a-48fb-bbd0-ee77ad94445f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:17.319403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49770bb6-ff4a-48fb-bbd0-ee77ad94445f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:17.320178 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49770bb6-ff4a-48fb-bbd0-ee77ad94445f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:17.320617 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49770bb6-ff4a-48fb-bbd0-ee77ad94445f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:17.536757 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cc2a1247-fdd9-4976-a32e-4345eb6397a6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:17.545528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cc2a1247-fdd9-4976-a32e-4345eb6397a6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.522834 Jan 28 01:57:17.547717 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 42/88] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:17 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:17.552582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1bf3ed44-d243-4bdb-bc44-5b185514ed68 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:17.553442 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1bf3ed44-d243-4bdb-bc44-5b185514ed68 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:17.561248 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1bf3ed44-d243-4bdb-bc44-5b185514ed68 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:17.561759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1bf3ed44-d243-4bdb-bc44-5b185514ed68 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:17.568193 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1bf3ed44-d243-4bdb-bc44-5b185514ed68 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:17.568691 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1bf3ed44-d243-4bdb-bc44-5b185514ed68 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:17.719932 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-49770bb6-ff4a-48fb-bbd0-ee77ad94445f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:17.729389 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-49770bb6-ff4a-48fb-bbd0-ee77ad94445f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.420377 Jan 28 01:57:17.730160 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 47/89] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:17 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:17.904843 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1bf3ed44-d243-4bdb-bc44-5b185514ed68 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:17.916052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1bf3ed44-d243-4bdb-bc44-5b185514ed68 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.366421 Jan 28 01:57:17.916812 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 43/90] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:17 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:18.151997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-f1090428-de2c-4d5f-82ca-692392a56e02 req-a5c66233-a0ee-47ba-95f6-e0c161016962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c", "tag": "4589897f-4d9d-4d78-97c1-85b8537fd56d"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:18.157113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:18.157113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 01:57:18.168160 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f1090428-de2c-4d5f-82ca-692392a56e02 req-a5c66233-a0ee-47ba-95f6-e0c161016962 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.168614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f1090428-de2c-4d5f-82ca-692392a56e02 req-a5c66233-a0ee-47ba-95f6-e0c161016962 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:18.203720 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-f1090428-de2c-4d5f-82ca-692392a56e02 req-a5c66233-a0ee-47ba-95f6-e0c161016962 service nova] Creating event network-changed:4589897f-4d9d-4d78-97c1-85b8537fd56d for instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c on hv-cinder-82497 Jan 28 01:57:18.207721 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-f1090428-de2c-4d5f-82ca-692392a56e02 req-a5c66233-a0ee-47ba-95f6-e0c161016962 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059487 Jan 28 01:57:18.208416 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 48/91] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:18.330113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:18.330734 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:18.336817 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.337272 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:18.338130 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.338568 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:18.480852 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:18.497187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:18.499640 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:18.501420 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4ec85379-4154-4162-b563-eb5d6f001acd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.174712 Jan 28 01:57:18.502416 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 44/92] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:18 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:18.566840 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fa8651e8-7837-426f-9e2f-fc504c524fd7 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:18.567554 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fa8651e8-7837-426f-9e2f-fc504c524fd7 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:18.573748 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa8651e8-7837-426f-9e2f-fc504c524fd7 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.574204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa8651e8-7837-426f-9e2f-fc504c524fd7 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:18.574977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa8651e8-7837-426f-9e2f-fc504c524fd7 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.575579 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa8651e8-7837-426f-9e2f-fc504c524fd7 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:18.712949 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fa8651e8-7837-426f-9e2f-fc504c524fd7 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:18.721869 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fa8651e8-7837-426f-9e2f-fc504c524fd7 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.158917 Jan 28 01:57:18.730460 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 49/93] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:18 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:18.746427 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9dcfd5b3-4762-4466-b283-b5a8cef38a52 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:18.747087 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9dcfd5b3-4762-4466-b283-b5a8cef38a52 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:18.753667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dcfd5b3-4762-4466-b283-b5a8cef38a52 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.754144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dcfd5b3-4762-4466-b283-b5a8cef38a52 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:18.754917 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dcfd5b3-4762-4466-b283-b5a8cef38a52 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.755390 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dcfd5b3-4762-4466-b283-b5a8cef38a52 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:18.892410 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9dcfd5b3-4762-4466-b283-b5a8cef38a52 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:18.899742 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9dcfd5b3-4762-4466-b283-b5a8cef38a52 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.157287 Jan 28 01:57:18.900334 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 45/94] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:18 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:18.933707 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f57635a5-575a-4bca-8f97-ba56e150306c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:18.934324 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f57635a5-575a-4bca-8f97-ba56e150306c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:18.943343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f57635a5-575a-4bca-8f97-ba56e150306c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.944017 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f57635a5-575a-4bca-8f97-ba56e150306c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:18.945575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f57635a5-575a-4bca-8f97-ba56e150306c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:18.946205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f57635a5-575a-4bca-8f97-ba56e150306c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:19.086810 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f57635a5-575a-4bca-8f97-ba56e150306c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:19.097188 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f57635a5-575a-4bca-8f97-ba56e150306c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.167154 Jan 28 01:57:19.097879 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 50/95] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:18 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:19.540321 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:19.540985 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:19.549259 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:19.549820 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:19.550990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:19.551733 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:19.714830 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:19.724888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:19.726463 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:19.727901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-de44560b-0c83-48d3-9d1b-984fcf377aef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.191085 Jan 28 01:57:19.728482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 46/96] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:19 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:57:19.742035 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d190016f-6308-4554-81ba-24a4dd94ca5c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:19.743155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d190016f-6308-4554-81ba-24a4dd94ca5c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:19.761562 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d190016f-6308-4554-81ba-24a4dd94ca5c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:19.763133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d190016f-6308-4554-81ba-24a4dd94ca5c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:19.765143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d190016f-6308-4554-81ba-24a4dd94ca5c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:19.766234 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d190016f-6308-4554-81ba-24a4dd94ca5c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:19.919413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-684e9d12-890f-498b-ba41-baced2a974a4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:19.920348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-684e9d12-890f-498b-ba41-baced2a974a4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:19.935656 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-684e9d12-890f-498b-ba41-baced2a974a4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:19.936511 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-684e9d12-890f-498b-ba41-baced2a974a4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:19.950009 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-684e9d12-890f-498b-ba41-baced2a974a4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:19.951219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-684e9d12-890f-498b-ba41-baced2a974a4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:20.036486 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d190016f-6308-4554-81ba-24a4dd94ca5c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:20.044159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d190016f-6308-4554-81ba-24a4dd94ca5c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.309496 Jan 28 01:57:20.054269 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 51/97] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:19 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:20.115794 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-96c88c4b-4206-49e2-9f8a-af56722f2aaa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:20.119957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-96c88c4b-4206-49e2-9f8a-af56722f2aaa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:20.151033 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96c88c4b-4206-49e2-9f8a-af56722f2aaa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:20.151491 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96c88c4b-4206-49e2-9f8a-af56722f2aaa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:20.152289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96c88c4b-4206-49e2-9f8a-af56722f2aaa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:20.152730 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96c88c4b-4206-49e2-9f8a-af56722f2aaa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:20.193609 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-684e9d12-890f-498b-ba41-baced2a974a4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:20.216834 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-684e9d12-890f-498b-ba41-baced2a974a4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.302801 Jan 28 01:57:20.218400 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 47/98] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:19 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:20.423724 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-96c88c4b-4206-49e2-9f8a-af56722f2aaa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:20.435201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-96c88c4b-4206-49e2-9f8a-af56722f2aaa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.323660 Jan 28 01:57:20.437072 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 52/99] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:20 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:20.749599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:20.751211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:20.767010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:20.767464 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:20.770483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:20.771006 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:21.082428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-461ca170-fc2f-4657-bea4-6cc8325cf310 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:21.092423 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:21.099289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-461ca170-fc2f-4657-bea4-6cc8325cf310 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:21.126760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:21.135532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-461ca170-fc2f-4657-bea4-6cc8325cf310 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:21.136564 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-461ca170-fc2f-4657-bea4-6cc8325cf310 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:21.139357 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:21.140511 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-461ca170-fc2f-4657-bea4-6cc8325cf310 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:21.144064 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-461ca170-fc2f-4657-bea4-6cc8325cf310 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:21.146818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-85a32a10-97b4-463e-98e9-369a0b638510 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.401010 Jan 28 01:57:21.149125 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 48/100] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:20 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:21.241662 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-195f6267-60b7-4f49-8df8-7ec8ec48b422 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:21.247879 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-195f6267-60b7-4f49-8df8-7ec8ec48b422 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:21.286871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-195f6267-60b7-4f49-8df8-7ec8ec48b422 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:21.288002 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-195f6267-60b7-4f49-8df8-7ec8ec48b422 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:21.289627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-195f6267-60b7-4f49-8df8-7ec8ec48b422 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:21.290659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-195f6267-60b7-4f49-8df8-7ec8ec48b422 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:21.613429 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-461ca170-fc2f-4657-bea4-6cc8325cf310 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:21.640627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-195f6267-60b7-4f49-8df8-7ec8ec48b422 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:21.650015 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-461ca170-fc2f-4657-bea4-6cc8325cf310 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.589271 Jan 28 01:57:21.659799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-195f6267-60b7-4f49-8df8-7ec8ec48b422 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.426233 Jan 28 01:57:21.678442 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 53/101] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:21 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:21.721770 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-454a9092-6131-4f7f-84b9-240ea95816bf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:21.722815 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-454a9092-6131-4f7f-84b9-240ea95816bf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:21.727032 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 49/102] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:21 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:21.737351 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-454a9092-6131-4f7f-84b9-240ea95816bf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:21.739099 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-454a9092-6131-4f7f-84b9-240ea95816bf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:21.741465 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-454a9092-6131-4f7f-84b9-240ea95816bf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:21.742184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-454a9092-6131-4f7f-84b9-240ea95816bf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:22.021544 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-454a9092-6131-4f7f-84b9-240ea95816bf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:22.033350 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-454a9092-6131-4f7f-84b9-240ea95816bf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.351748 Jan 28 01:57:22.034598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 54/103] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:21 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:22.172841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:22.174254 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:22.182118 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:22.182852 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:22.183832 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:22.184583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:22.387871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:22.401758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:22.404991 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:22.409550 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7585e42b-641c-4686-bfda-dc3715ef7cef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.244239 Jan 28 01:57:22.411817 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 50/104] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:22 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:57:22.685559 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-14d0650a-4100-4609-892f-065dc3925cd6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:22.686212 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-14d0650a-4100-4609-892f-065dc3925cd6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:22.699348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-14d0650a-4100-4609-892f-065dc3925cd6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:22.699973 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-14d0650a-4100-4609-892f-065dc3925cd6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:22.700913 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-14d0650a-4100-4609-892f-065dc3925cd6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:22.701596 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-14d0650a-4100-4609-892f-065dc3925cd6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:22.716483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bb51a336-3aa9-4860-a7ba-43cb9b4ad029 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:22.717257 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bb51a336-3aa9-4860-a7ba-43cb9b4ad029 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:22.726798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bb51a336-3aa9-4860-a7ba-43cb9b4ad029 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:22.727260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bb51a336-3aa9-4860-a7ba-43cb9b4ad029 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:22.729007 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bb51a336-3aa9-4860-a7ba-43cb9b4ad029 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:22.729007 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bb51a336-3aa9-4860-a7ba-43cb9b4ad029 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:22.930104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-14d0650a-4100-4609-892f-065dc3925cd6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:22.936989 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bb51a336-3aa9-4860-a7ba-43cb9b4ad029 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:22.940055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-14d0650a-4100-4609-892f-065dc3925cd6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.258188 Jan 28 01:57:22.940866 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 55/105] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:22 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:22.950240 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bb51a336-3aa9-4860-a7ba-43cb9b4ad029 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.233089 Jan 28 01:57:22.950240 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 51/106] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:22 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:23.050990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-43955f1e-d6b9-421f-b138-4a3f9cfb464b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:23.051592 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-43955f1e-d6b9-421f-b138-4a3f9cfb464b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:23.058529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43955f1e-d6b9-421f-b138-4a3f9cfb464b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:23.059012 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43955f1e-d6b9-421f-b138-4a3f9cfb464b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:23.059803 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43955f1e-d6b9-421f-b138-4a3f9cfb464b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:23.060676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43955f1e-d6b9-421f-b138-4a3f9cfb464b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:23.194919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-43955f1e-d6b9-421f-b138-4a3f9cfb464b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:23.203136 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-43955f1e-d6b9-421f-b138-4a3f9cfb464b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.155514 Jan 28 01:57:23.203847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 52/107] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:23 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:23.438488 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:23.439192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:23.445009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:23.445538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:23.446375 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:23.446873 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:23.637720 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:23.646729 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:23.648581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:23.649435 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4ea4ae51-3b03-4862-a7ff-0e2317c28eba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.215597 Jan 28 01:57:23.650067 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 56/108] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:23 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:23.961474 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4083c563-d9c9-4180-bb32-60873584a589 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:23.962309 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4083c563-d9c9-4180-bb32-60873584a589 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:23.964210 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-61fcd6ed-8b98-429e-84f9-8f64563b2644 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:23.964938 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-61fcd6ed-8b98-429e-84f9-8f64563b2644 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:23.970016 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4083c563-d9c9-4180-bb32-60873584a589 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:23.970797 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4083c563-d9c9-4180-bb32-60873584a589 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:23.971777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4083c563-d9c9-4180-bb32-60873584a589 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:23.971997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61fcd6ed-8b98-429e-84f9-8f64563b2644 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:23.972405 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4083c563-d9c9-4180-bb32-60873584a589 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:23.972551 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61fcd6ed-8b98-429e-84f9-8f64563b2644 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:23.973345 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61fcd6ed-8b98-429e-84f9-8f64563b2644 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:23.973782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61fcd6ed-8b98-429e-84f9-8f64563b2644 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:24.630368 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-61fcd6ed-8b98-429e-84f9-8f64563b2644 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:24.640019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-61fcd6ed-8b98-429e-84f9-8f64563b2644 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.680146 Jan 28 01:57:24.647998 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 57/109] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:23 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:24.656402 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4f5e4137-a11f-4a83-a564-b55b119e5087 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:24.656743 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4083c563-d9c9-4180-bb32-60873584a589 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:24.658529 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4f5e4137-a11f-4a83-a564-b55b119e5087 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:24.668436 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4083c563-d9c9-4180-bb32-60873584a589 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.712091 Jan 28 01:57:24.674369 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f5e4137-a11f-4a83-a564-b55b119e5087 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:24.675415 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f5e4137-a11f-4a83-a564-b55b119e5087 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:24.677999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f5e4137-a11f-4a83-a564-b55b119e5087 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:24.678544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 53/110] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:23 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:24.678806 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f5e4137-a11f-4a83-a564-b55b119e5087 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:24.683857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:24.684704 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:24.693170 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:24.693843 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:24.694793 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:24.695367 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:25.119026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4f5e4137-a11f-4a83-a564-b55b119e5087 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:25.132471 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:25.173466 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:25.175096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4f5e4137-a11f-4a83-a564-b55b119e5087 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.519397 Jan 28 01:57:25.176430 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 58/111] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:24 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:25.178982 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:25.180715 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1019e449-1825-4a0c-abf7-66dcd893c50c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.500658 Jan 28 01:57:25.189821 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 54/112] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:24 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:25.665193 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5f8bf4a1-5249-43e4-910d-0a1929e4861d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:25.666507 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5f8bf4a1-5249-43e4-910d-0a1929e4861d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:25.678602 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f8bf4a1-5249-43e4-910d-0a1929e4861d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:25.678989 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f8bf4a1-5249-43e4-910d-0a1929e4861d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:25.680379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f8bf4a1-5249-43e4-910d-0a1929e4861d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:25.681164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f8bf4a1-5249-43e4-910d-0a1929e4861d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:25.687787 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-19affb71-2160-4fdf-a7b2-a68cd3f251ce tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:25.688490 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-19affb71-2160-4fdf-a7b2-a68cd3f251ce tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:25.699305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19affb71-2160-4fdf-a7b2-a68cd3f251ce tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:25.699826 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19affb71-2160-4fdf-a7b2-a68cd3f251ce tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:25.700978 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19affb71-2160-4fdf-a7b2-a68cd3f251ce tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:25.701792 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19affb71-2160-4fdf-a7b2-a68cd3f251ce tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:26.016662 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5f8bf4a1-5249-43e4-910d-0a1929e4861d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:26.020611 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-19affb71-2160-4fdf-a7b2-a68cd3f251ce tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:26.033049 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5f8bf4a1-5249-43e4-910d-0a1929e4861d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.374463 Jan 28 01:57:26.033419 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-19affb71-2160-4fdf-a7b2-a68cd3f251ce tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.351195 Jan 28 01:57:26.044519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 55/113] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:25 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:26.044519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-0a78ceac-d423-4249-bea1-40e03bcd5f2e req-80194045-275c-4c97-b278-c34e8fc76b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1879ef-ae58-41eb-9c13-3f9a3988a970", "tag": "d9332855-e3dc-42d6-9f2e-2138fd34387d"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:26.044519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:26.044519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:57:26.049069 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 59/114] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:25 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:26.055173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-0a78ceac-d423-4249-bea1-40e03bcd5f2e req-80194045-275c-4c97-b278-c34e8fc76b05 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:26.056066 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-0a78ceac-d423-4249-bea1-40e03bcd5f2e req-80194045-275c-4c97-b278-c34e8fc76b05 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:26.073930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-0a78ceac-d423-4249-bea1-40e03bcd5f2e req-80194045-275c-4c97-b278-c34e8fc76b05 service nova] Creating event network-changed:d9332855-e3dc-42d6-9f2e-2138fd34387d for instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 on hv-cinder-82497 Jan 28 01:57:26.080109 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-0a78ceac-d423-4249-bea1-40e03bcd5f2e req-80194045-275c-4c97-b278-c34e8fc76b05 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043537 Jan 28 01:57:26.080724 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 56/115] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:26.196595 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-61a5e866-1469-4e91-9bea-4a8e70868c61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:26.197428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-61a5e866-1469-4e91-9bea-4a8e70868c61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:26.205381 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61a5e866-1469-4e91-9bea-4a8e70868c61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:26.206249 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61a5e866-1469-4e91-9bea-4a8e70868c61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:26.207665 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:26.207795 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61a5e866-1469-4e91-9bea-4a8e70868c61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:26.208455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61a5e866-1469-4e91-9bea-4a8e70868c61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:26.208567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:26.217913 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:26.218422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:26.219418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:26.219956 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:26.438680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-61a5e866-1469-4e91-9bea-4a8e70868c61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:26.445773 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:26.449805 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-61a5e866-1469-4e91-9bea-4a8e70868c61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.258780 Jan 28 01:57:26.450415 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 60/116] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:26 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:26.456564 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:26.458484 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:26.459981 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-68f9ae0d-2163-4652-afa9-3a720659f5d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.256981 Jan 28 01:57:26.460880 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 57/117] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:26 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:57:27.053080 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b98c3093-1863-4ac4-bb54-a07e8ef9c0d6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:27.053680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b98c3093-1863-4ac4-bb54-a07e8ef9c0d6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:27.059774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b98c3093-1863-4ac4-bb54-a07e8ef9c0d6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:27.060139 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b98c3093-1863-4ac4-bb54-a07e8ef9c0d6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:27.060991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b98c3093-1863-4ac4-bb54-a07e8ef9c0d6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:27.062112 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b98c3093-1863-4ac4-bb54-a07e8ef9c0d6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:27.071199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-60db995a-8938-46af-872a-e1247c7be6d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:27.072098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-60db995a-8938-46af-872a-e1247c7be6d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:27.084064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60db995a-8938-46af-872a-e1247c7be6d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:27.090626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60db995a-8938-46af-872a-e1247c7be6d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:27.090626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60db995a-8938-46af-872a-e1247c7be6d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:27.090626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60db995a-8938-46af-872a-e1247c7be6d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:27.309694 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b98c3093-1863-4ac4-bb54-a07e8ef9c0d6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:27.327547 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-60db995a-8938-46af-872a-e1247c7be6d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:27.340834 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-60db995a-8938-46af-872a-e1247c7be6d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.275491 Jan 28 01:57:27.341877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 58/118] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:27 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:27.342787 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b98c3093-1863-4ac4-bb54-a07e8ef9c0d6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.293745 Jan 28 01:57:27.344181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 61/119] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:27 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:27.473496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ed9125df-f189-40d8-8a4f-60450ac28e4d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:27.476666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ed9125df-f189-40d8-8a4f-60450ac28e4d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:27.483453 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:27.484720 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:27.487472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed9125df-f189-40d8-8a4f-60450ac28e4d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:27.488835 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed9125df-f189-40d8-8a4f-60450ac28e4d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:27.489561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed9125df-f189-40d8-8a4f-60450ac28e4d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:27.491726 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed9125df-f189-40d8-8a4f-60450ac28e4d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:27.503218 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:27.506068 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:27.507639 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:27.510213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:28.647234 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:28.663687 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:28.667506 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:28.670122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7ee795ca-a9f3-4d27-905b-2d30e43eb8ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 1.192073 Jan 28 01:57:28.671303 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 62/120] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:27 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:57:28.690975 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ebe888d9-03aa-4253-bea5-752dac383679 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:28.691494 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ebe888d9-03aa-4253-bea5-752dac383679 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:28.697932 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebe888d9-03aa-4253-bea5-752dac383679 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:28.698376 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebe888d9-03aa-4253-bea5-752dac383679 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:28.699163 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebe888d9-03aa-4253-bea5-752dac383679 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:28.699782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebe888d9-03aa-4253-bea5-752dac383679 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:28.778636 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ed9125df-f189-40d8-8a4f-60450ac28e4d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:28.801370 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ed9125df-f189-40d8-8a4f-60450ac28e4d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 1.335769 Jan 28 01:57:28.811798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 59/121] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:27 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:28.811798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8c90ba73-4464-4111-87de-b9f049b71097 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:28.811798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8c90ba73-4464-4111-87de-b9f049b71097 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:28.815200 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c90ba73-4464-4111-87de-b9f049b71097 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:28.815602 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c90ba73-4464-4111-87de-b9f049b71097 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:28.816513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c90ba73-4464-4111-87de-b9f049b71097 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:28.817249 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c90ba73-4464-4111-87de-b9f049b71097 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:29.457743 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ebe888d9-03aa-4253-bea5-752dac383679 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:29.484107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ebe888d9-03aa-4253-bea5-752dac383679 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.809795 Jan 28 01:57:29.502627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 63/122] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:28 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:29.558840 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8c90ba73-4464-4111-87de-b9f049b71097 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:29.577148 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8c90ba73-4464-4111-87de-b9f049b71097 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.773335 Jan 28 01:57:29.578756 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 60/123] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:28 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:29.704342 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:29.705707 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:29.721380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:29.724026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:29.726250 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:29.727462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:29.827887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dac94229-cdf0-4693-898a-14b384a78af9 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:29.829605 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dac94229-cdf0-4693-898a-14b384a78af9 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:29.842902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dac94229-cdf0-4693-898a-14b384a78af9 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:29.844182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dac94229-cdf0-4693-898a-14b384a78af9 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:29.845792 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dac94229-cdf0-4693-898a-14b384a78af9 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:29.848301 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dac94229-cdf0-4693-898a-14b384a78af9 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:30.577602 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:30.594362 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:30.596361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:30.598113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-77ebd584-09d8-42b8-9761-0e18fe890eca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.902203 Jan 28 01:57:30.599187 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 64/124] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:29 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:30.604020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bf498111-437c-4793-b102-7b13cd62ebe1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:30.604933 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bf498111-437c-4793-b102-7b13cd62ebe1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:30.612253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf498111-437c-4793-b102-7b13cd62ebe1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:30.612997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf498111-437c-4793-b102-7b13cd62ebe1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:30.614048 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf498111-437c-4793-b102-7b13cd62ebe1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:30.614659 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf498111-437c-4793-b102-7b13cd62ebe1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:30.635724 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dac94229-cdf0-4693-898a-14b384a78af9 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:30.665172 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dac94229-cdf0-4693-898a-14b384a78af9 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.848130 Jan 28 01:57:30.668463 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 61/125] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:29 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:30.676489 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5770a654-cc1e-4aa1-85b6-0454d8ee58c9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:30.677798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5770a654-cc1e-4aa1-85b6-0454d8ee58c9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:30.685082 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5770a654-cc1e-4aa1-85b6-0454d8ee58c9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:30.685821 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5770a654-cc1e-4aa1-85b6-0454d8ee58c9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:30.686963 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5770a654-cc1e-4aa1-85b6-0454d8ee58c9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:30.687795 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5770a654-cc1e-4aa1-85b6-0454d8ee58c9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:30.975056 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bf498111-437c-4793-b102-7b13cd62ebe1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:30.993930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5770a654-cc1e-4aa1-85b6-0454d8ee58c9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:30.996158 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bf498111-437c-4793-b102-7b13cd62ebe1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.393037 Jan 28 01:57:30.998393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 65/126] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:30 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:31.009434 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5770a654-cc1e-4aa1-85b6-0454d8ee58c9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.338125 Jan 28 01:57:31.010879 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 62/127] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:30 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:31.639927 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:31.642214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:31.662270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:31.665523 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:31.667465 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:31.668289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:31.695186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8b05b68d-a097-4e00-b35f-0482f9004df5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:31.697138 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8b05b68d-a097-4e00-b35f-0482f9004df5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:31.713633 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b05b68d-a097-4e00-b35f-0482f9004df5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:31.718891 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b05b68d-a097-4e00-b35f-0482f9004df5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:31.723906 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b05b68d-a097-4e00-b35f-0482f9004df5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:31.725087 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b05b68d-a097-4e00-b35f-0482f9004df5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:32.002273 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:32.006246 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8b05b68d-a097-4e00-b35f-0482f9004df5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:32.016231 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:32.018976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8b05b68d-a097-4e00-b35f-0482f9004df5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.329129 Jan 28 01:57:32.034876 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 63/128] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:31 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:32.036218 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:32.036617 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8b5d852c-20e8-4206-8d64-80cf1d0dcfe6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:32.036617 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8b5d852c-20e8-4206-8d64-80cf1d0dcfe6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:32.036887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fb130cc0-eda8-477e-8625-b49df9404cca tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.400711 Jan 28 01:57:32.036887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 66/129] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:31 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:32.040227 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6fd69dfc-10dd-4a76-9533-c20d1cc72465 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:32.041334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6fd69dfc-10dd-4a76-9533-c20d1cc72465 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:32.045417 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b5d852c-20e8-4206-8d64-80cf1d0dcfe6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:32.047147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b5d852c-20e8-4206-8d64-80cf1d0dcfe6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:32.047804 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b5d852c-20e8-4206-8d64-80cf1d0dcfe6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:32.048402 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b5d852c-20e8-4206-8d64-80cf1d0dcfe6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:32.050039 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fd69dfc-10dd-4a76-9533-c20d1cc72465 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:32.050514 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fd69dfc-10dd-4a76-9533-c20d1cc72465 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:32.051624 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fd69dfc-10dd-4a76-9533-c20d1cc72465 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:32.052082 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fd69dfc-10dd-4a76-9533-c20d1cc72465 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:32.383663 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6fd69dfc-10dd-4a76-9533-c20d1cc72465 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:32.397259 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6fd69dfc-10dd-4a76-9533-c20d1cc72465 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.364709 Jan 28 01:57:32.399225 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 67/130] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:32 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:32.430894 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8b5d852c-20e8-4206-8d64-80cf1d0dcfe6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:32.458639 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8b5d852c-20e8-4206-8d64-80cf1d0dcfe6 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.430259 Jan 28 01:57:32.458639 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 64/131] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:32 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:33.042381 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fe87b75b-6433-433a-aaa9-8bac0323f12f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:33.044266 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fe87b75b-6433-433a-aaa9-8bac0323f12f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:33.052261 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:33.052839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:33.064248 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:33.066257 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe87b75b-6433-433a-aaa9-8bac0323f12f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:33.067030 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:33.068135 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:33.069326 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:33.069575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe87b75b-6433-433a-aaa9-8bac0323f12f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:33.070618 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe87b75b-6433-433a-aaa9-8bac0323f12f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:33.073995 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe87b75b-6433-433a-aaa9-8bac0323f12f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:33.512372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:33.534799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:33.539090 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:33.539319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fe87b75b-6433-433a-aaa9-8bac0323f12f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:33.541913 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-aa668442-1236-4633-bea8-20bc2faa20ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.493428 Jan 28 01:57:33.544670 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 65/132] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:33 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:57:33.561386 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e26f1c38-77d5-4233-8173-55a1df22259a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:33.562808 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e26f1c38-77d5-4233-8173-55a1df22259a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:33.569070 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fe87b75b-6433-433a-aaa9-8bac0323f12f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.530896 Jan 28 01:57:33.569684 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 68/133] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:33 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:33.574651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0ad4d1fc-aca4-451a-99e4-e5cb256658f4 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:33.575322 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0ad4d1fc-aca4-451a-99e4-e5cb256658f4 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:33.581843 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e26f1c38-77d5-4233-8173-55a1df22259a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:33.582725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e26f1c38-77d5-4233-8173-55a1df22259a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:33.585515 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e26f1c38-77d5-4233-8173-55a1df22259a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:33.586305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e26f1c38-77d5-4233-8173-55a1df22259a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:33.595552 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ad4d1fc-aca4-451a-99e4-e5cb256658f4 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:33.596014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ad4d1fc-aca4-451a-99e4-e5cb256658f4 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:33.596870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ad4d1fc-aca4-451a-99e4-e5cb256658f4 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:33.597314 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ad4d1fc-aca4-451a-99e4-e5cb256658f4 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:34.061901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e26f1c38-77d5-4233-8173-55a1df22259a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:34.069216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e26f1c38-77d5-4233-8173-55a1df22259a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.522036 Jan 28 01:57:34.069779 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 66/134] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:33 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:34.095157 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0ad4d1fc-aca4-451a-99e4-e5cb256658f4 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:34.103158 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0ad4d1fc-aca4-451a-99e4-e5cb256658f4 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.532346 Jan 28 01:57:34.112849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 69/135] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:33 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:34.517496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-cb433d58-1735-4607-83a6-425721026417 req-3e82e707-0ebd-42d6-bbf4-07160982a32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1879ef-ae58-41eb-9c13-3f9a3988a970", "name": "network-vif-plugged", "status": "completed", "tag": "d9332855-e3dc-42d6-9f2e-2138fd34387d"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:34.519320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:34.519320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:57:34.538697 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-cb433d58-1735-4607-83a6-425721026417 req-3e82e707-0ebd-42d6-bbf4-07160982a32a service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:34.539139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-cb433d58-1735-4607-83a6-425721026417 req-3e82e707-0ebd-42d6-bbf4-07160982a32a service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:34.565266 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:34.565884 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:34.575244 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-cb433d58-1735-4607-83a6-425721026417 req-3e82e707-0ebd-42d6-bbf4-07160982a32a service nova] Creating event network-vif-plugged:d9332855-e3dc-42d6-9f2e-2138fd34387d for instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 on hv-cinder-82497 Jan 28 01:57:34.578600 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:34.579046 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:34.579839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:34.580275 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:34.588450 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-cb433d58-1735-4607-83a6-425721026417 req-3e82e707-0ebd-42d6-bbf4-07160982a32a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379532 Jan 28 01:57:34.590945 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 67/136] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:34.604836 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bcafaa5a-4537-4192-8d53-32589dd968dd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:34.605874 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bcafaa5a-4537-4192-8d53-32589dd968dd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:34.617370 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bcafaa5a-4537-4192-8d53-32589dd968dd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:34.618396 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bcafaa5a-4537-4192-8d53-32589dd968dd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:34.618632 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bcafaa5a-4537-4192-8d53-32589dd968dd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:34.629501 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bcafaa5a-4537-4192-8d53-32589dd968dd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:34.946609 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:34.953653 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bcafaa5a-4537-4192-8d53-32589dd968dd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:34.962728 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:34.966475 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:34.969861 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1a3b662c-dbe0-4485-a87a-6ecd8c02c3e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.409927 Jan 28 01:57:34.976933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bcafaa5a-4537-4192-8d53-32589dd968dd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.384482 Jan 28 01:57:34.978336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 70/137] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:34 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:34.988062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 68/138] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:34 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:35.085764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-75779abb-d65b-4ee2-b0fc-5dd4f944f492 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:35.086767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-75779abb-d65b-4ee2-b0fc-5dd4f944f492 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:35.095398 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75779abb-d65b-4ee2-b0fc-5dd4f944f492 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:35.097953 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75779abb-d65b-4ee2-b0fc-5dd4f944f492 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:35.100158 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75779abb-d65b-4ee2-b0fc-5dd4f944f492 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:35.100900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75779abb-d65b-4ee2-b0fc-5dd4f944f492 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:35.120900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1a1dd833-260c-4f6b-9907-8765aaf768cb tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:35.121694 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1a1dd833-260c-4f6b-9907-8765aaf768cb tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:35.130513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a1dd833-260c-4f6b-9907-8765aaf768cb tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:35.130961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a1dd833-260c-4f6b-9907-8765aaf768cb tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:35.134062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a1dd833-260c-4f6b-9907-8765aaf768cb tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:35.134513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a1dd833-260c-4f6b-9907-8765aaf768cb tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:35.368525 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-75779abb-d65b-4ee2-b0fc-5dd4f944f492 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:35.380811 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-75779abb-d65b-4ee2-b0fc-5dd4f944f492 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.295924 Jan 28 01:57:35.381998 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 71/139] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:35 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:35.398978 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1a1dd833-260c-4f6b-9907-8765aaf768cb tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:35.409279 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1a1dd833-260c-4f6b-9907-8765aaf768cb tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.290613 Jan 28 01:57:35.416642 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 69/140] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:35 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:35.998553 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:35.999249 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-60647ff5-2d14-4220-9b8d-fbd344938df7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:36.000459 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-60647ff5-2d14-4220-9b8d-fbd344938df7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:36.001553 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:36.016870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:36.018259 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60647ff5-2d14-4220-9b8d-fbd344938df7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:36.019014 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60647ff5-2d14-4220-9b8d-fbd344938df7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:36.020872 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:36.021937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60647ff5-2d14-4220-9b8d-fbd344938df7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:36.022610 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60647ff5-2d14-4220-9b8d-fbd344938df7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:36.023686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:36.026049 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:36.274236 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-60647ff5-2d14-4220-9b8d-fbd344938df7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:36.288397 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-60647ff5-2d14-4220-9b8d-fbd344938df7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.297562 Jan 28 01:57:36.292081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:36.292626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 70/141] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:35 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:36.307631 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:36.310192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:36.315319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6b9a0ec5-190d-4d8f-b8ca-acc8e90b813b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1406 microversion: 2.20 time: 0.326490 Jan 28 01:57:36.316878 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 72/142] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:35 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:36.400553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bb206afb-ec07-4560-a2dc-e7bced3e1e6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:36.401535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bb206afb-ec07-4560-a2dc-e7bced3e1e6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:36.411637 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bb206afb-ec07-4560-a2dc-e7bced3e1e6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:36.412145 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bb206afb-ec07-4560-a2dc-e7bced3e1e6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:36.413052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bb206afb-ec07-4560-a2dc-e7bced3e1e6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:36.413560 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bb206afb-ec07-4560-a2dc-e7bced3e1e6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:36.423256 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cc4006b6-6a8f-4280-9e68-763a64c0ac5a tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:36.424145 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cc4006b6-6a8f-4280-9e68-763a64c0ac5a tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:36.430377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc4006b6-6a8f-4280-9e68-763a64c0ac5a tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:36.430902 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc4006b6-6a8f-4280-9e68-763a64c0ac5a tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:36.431746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc4006b6-6a8f-4280-9e68-763a64c0ac5a tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:36.432399 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc4006b6-6a8f-4280-9e68-763a64c0ac5a tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:36.647905 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bb206afb-ec07-4560-a2dc-e7bced3e1e6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:36.651534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cc4006b6-6a8f-4280-9e68-763a64c0ac5a tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:36.659780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cc4006b6-6a8f-4280-9e68-763a64c0ac5a tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.240136 Jan 28 01:57:36.660007 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bb206afb-ec07-4560-a2dc-e7bced3e1e6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.263288 Jan 28 01:57:36.660362 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 73/143] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:36 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:36.661178 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 71/144] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:36 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:37.307976 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ccebb00e-f22f-4361-b8a5-08216088d569 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:37.308593 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ccebb00e-f22f-4361-b8a5-08216088d569 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:37.317636 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ccebb00e-f22f-4361-b8a5-08216088d569 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.318342 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ccebb00e-f22f-4361-b8a5-08216088d569 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.319314 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ccebb00e-f22f-4361-b8a5-08216088d569 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.319910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ccebb00e-f22f-4361-b8a5-08216088d569 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.335821 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:37.336586 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:37.347113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.347704 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.349207 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.350329 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.554452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ccebb00e-f22f-4361-b8a5-08216088d569 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:37.566547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ccebb00e-f22f-4361-b8a5-08216088d569 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.260964 Jan 28 01:57:37.567815 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 74/145] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:37 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:37.576302 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:37.587564 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:37.589422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:37.591124 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0f67377a-3ede-4c45-b4d1-d145bcd374e2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1598 microversion: 2.20 time: 0.259672 Jan 28 01:57:37.592740 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 72/146] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:57:37 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1598 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:37.611662 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2a85ce95-b1e2-4fc9-afa5-c0b11a00e2e5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:37.611966 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2a85ce95-b1e2-4fc9-afa5-c0b11a00e2e5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:37.618032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a85ce95-b1e2-4fc9-afa5-c0b11a00e2e5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.618500 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a85ce95-b1e2-4fc9-afa5-c0b11a00e2e5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.619332 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a85ce95-b1e2-4fc9-afa5-c0b11a00e2e5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.619850 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a85ce95-b1e2-4fc9-afa5-c0b11a00e2e5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.637846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-bfd184c0-0052-4d8c-8cf2-f1470f849b18 req-5c345cca-2ed6-4ae6-a043-8c3dc3681e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93ca8fd-3477-43fa-9d41-56e66cb51528", "name": "network-vif-plugged", "status": "completed", "tag": "e841332d-7cf8-4dbd-bfef-9a71a9c23148"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:37.640169 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:37.640169 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:57:37.648865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-bfd184c0-0052-4d8c-8cf2-f1470f849b18 req-5c345cca-2ed6-4ae6-a043-8c3dc3681e6b service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.649529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-bfd184c0-0052-4d8c-8cf2-f1470f849b18 req-5c345cca-2ed6-4ae6-a043-8c3dc3681e6b service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.663857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-bfd184c0-0052-4d8c-8cf2-f1470f849b18 req-5c345cca-2ed6-4ae6-a043-8c3dc3681e6b service nova] Creating event network-vif-plugged:e841332d-7cf8-4dbd-bfef-9a71a9c23148 for instance a93ca8fd-3477-43fa-9d41-56e66cb51528 on hv-cinder-82497 Jan 28 01:57:37.673862 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-bfd184c0-0052-4d8c-8cf2-f1470f849b18 req-5c345cca-2ed6-4ae6-a043-8c3dc3681e6b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044919 Jan 28 01:57:37.675039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 73/147] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:37.681679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5d2c9d99-9326-4ecc-8824-efcc0c59ca6d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:37.682715 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5d2c9d99-9326-4ecc-8824-efcc0c59ca6d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:37.691710 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5d2c9d99-9326-4ecc-8824-efcc0c59ca6d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.692378 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5d2c9d99-9326-4ecc-8824-efcc0c59ca6d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.693569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5d2c9d99-9326-4ecc-8824-efcc0c59ca6d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.694815 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5d2c9d99-9326-4ecc-8824-efcc0c59ca6d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.835444 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2a85ce95-b1e2-4fc9-afa5-c0b11a00e2e5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.228579 Jan 28 01:57:37.836178 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 75/148] 10.222.0.96 () {60 vars in 1315 bytes} [Fri Jan 28 01:57:37 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:57:37.843893 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f060f80f-86e7-4fda-a0ce-2e35dd476d5c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:37.844786 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f060f80f-86e7-4fda-a0ce-2e35dd476d5c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:37.856009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f060f80f-86e7-4fda-a0ce-2e35dd476d5c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.856849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f060f80f-86e7-4fda-a0ce-2e35dd476d5c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.858013 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f060f80f-86e7-4fda-a0ce-2e35dd476d5c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:37.859192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f060f80f-86e7-4fda-a0ce-2e35dd476d5c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:37.869685 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5d2c9d99-9326-4ecc-8824-efcc0c59ca6d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:37.877828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5d2c9d99-9326-4ecc-8824-efcc0c59ca6d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.201224 Jan 28 01:57:37.879049 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 74/149] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:37 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:38.583253 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ee7fa6f7-e8e8-4b3a-a3d7-8e3fd20687db tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:38.583876 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ee7fa6f7-e8e8-4b3a-a3d7-8e3fd20687db tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:38.586102 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f060f80f-86e7-4fda-a0ce-2e35dd476d5c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:38.594874 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee7fa6f7-e8e8-4b3a-a3d7-8e3fd20687db tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:38.595336 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee7fa6f7-e8e8-4b3a-a3d7-8e3fd20687db tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:38.596097 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee7fa6f7-e8e8-4b3a-a3d7-8e3fd20687db tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:38.596528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee7fa6f7-e8e8-4b3a-a3d7-8e3fd20687db tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:38.596992 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f060f80f-86e7-4fda-a0ce-2e35dd476d5c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.758754 Jan 28 01:57:38.605731 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 76/150] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:37 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:38.895647 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dd8b994f-e2f2-4532-9253-3b2936f669ff tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:38.896278 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd8b994f-e2f2-4532-9253-3b2936f669ff tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:38.908105 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd8b994f-e2f2-4532-9253-3b2936f669ff tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:38.908605 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd8b994f-e2f2-4532-9253-3b2936f669ff tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:38.909448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd8b994f-e2f2-4532-9253-3b2936f669ff tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:38.909885 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd8b994f-e2f2-4532-9253-3b2936f669ff tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:39.065480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee7fa6f7-e8e8-4b3a-a3d7-8e3fd20687db tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:39.073269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ee7fa6f7-e8e8-4b3a-a3d7-8e3fd20687db tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.493577 Jan 28 01:57:39.081007 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 75/151] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:38 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:39.230480 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dd8b994f-e2f2-4532-9253-3b2936f669ff tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:39.241488 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dd8b994f-e2f2-4532-9253-3b2936f669ff tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.347586 Jan 28 01:57:39.242300 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 77/152] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:38 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:39.627188 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b95696e8-eb32-43b8-8928-9f7a3b6e9146 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:39.627803 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fc092238-ea6e-4df8-a121-7a8fc86efdfa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:39.628215 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fc092238-ea6e-4df8-a121-7a8fc86efdfa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:39.629131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b95696e8-eb32-43b8-8928-9f7a3b6e9146 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:39.641911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc092238-ea6e-4df8-a121-7a8fc86efdfa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:39.645125 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc092238-ea6e-4df8-a121-7a8fc86efdfa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:39.645938 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc092238-ea6e-4df8-a121-7a8fc86efdfa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:39.646360 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b95696e8-eb32-43b8-8928-9f7a3b6e9146 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:39.646491 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc092238-ea6e-4df8-a121-7a8fc86efdfa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:39.646908 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b95696e8-eb32-43b8-8928-9f7a3b6e9146 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:39.647617 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b95696e8-eb32-43b8-8928-9f7a3b6e9146 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:39.648047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b95696e8-eb32-43b8-8928-9f7a3b6e9146 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:39.846533 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fc092238-ea6e-4df8-a121-7a8fc86efdfa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.223762 Jan 28 01:57:39.847856 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 78/153] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:39 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:39.854849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-77bc36c1-c3d2-4003-b7a5-5c8917bedb19 req-45eeeee9-bd16-4e14-8d56-8b5946f390ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1879ef-ae58-41eb-9c13-3f9a3988a970", "tag": "d9332855-e3dc-42d6-9f2e-2138fd34387d"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:39.857147 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:39.857147 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 01:57:39.868415 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-77bc36c1-c3d2-4003-b7a5-5c8917bedb19 req-45eeeee9-bd16-4e14-8d56-8b5946f390ae service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:39.869228 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-77bc36c1-c3d2-4003-b7a5-5c8917bedb19 req-45eeeee9-bd16-4e14-8d56-8b5946f390ae service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:39.900591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-77bc36c1-c3d2-4003-b7a5-5c8917bedb19 req-45eeeee9-bd16-4e14-8d56-8b5946f390ae service nova] Creating event network-changed:d9332855-e3dc-42d6-9f2e-2138fd34387d for instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 on hv-cinder-82497 Jan 28 01:57:39.911105 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-77bc36c1-c3d2-4003-b7a5-5c8917bedb19 req-45eeeee9-bd16-4e14-8d56-8b5946f390ae service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060871 Jan 28 01:57:39.912756 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 79/154] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:39.920065 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-2645e29b-af01-4b74-85d4-f1c2863e8bc6 req-5bddc3a6-1b8b-41fb-9bc0-2d1bb18946bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5194c2-f570-4463-8a44-765cf06f1206", "name": "network-vif-plugged", "status": "completed", "tag": "cd5708fe-d124-49c1-b391-fcbc90e2b0d8"}, {"server_uuid": "d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c", "name": "network-vif-plugged", "status": "completed", "tag": "4589897f-4d9d-4d78-97c1-85b8537fd56d"}, {"server_uuid": "c4d2d895-fbb9-418c-a29a-6988b3992d10", "name": "network-vif-plugged", "status": "completed", "tag": "1139f116-1935-408c-a5bf-876a9f0d0365"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:39.922455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:39.922455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 01:57:39.937520 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-2645e29b-af01-4b74-85d4-f1c2863e8bc6 req-5bddc3a6-1b8b-41fb-9bc0-2d1bb18946bf service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:39.938317 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-2645e29b-af01-4b74-85d4-f1c2863e8bc6 req-5bddc3a6-1b8b-41fb-9bc0-2d1bb18946bf service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:39.970582 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-2645e29b-af01-4b74-85d4-f1c2863e8bc6 req-5bddc3a6-1b8b-41fb-9bc0-2d1bb18946bf service nova] Creating event network-vif-plugged:cd5708fe-d124-49c1-b391-fcbc90e2b0d8 for instance 6e5194c2-f570-4463-8a44-765cf06f1206 on hv-cinder-82497 Jan 28 01:57:39.971411 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-2645e29b-af01-4b74-85d4-f1c2863e8bc6 req-5bddc3a6-1b8b-41fb-9bc0-2d1bb18946bf service nova] Creating event network-vif-plugged:4589897f-4d9d-4d78-97c1-85b8537fd56d for instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c on hv-cinder-82497 Jan 28 01:57:39.972122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-2645e29b-af01-4b74-85d4-f1c2863e8bc6 req-5bddc3a6-1b8b-41fb-9bc0-2d1bb18946bf service nova] Creating event network-vif-plugged:1139f116-1935-408c-a5bf-876a9f0d0365 for instance c4d2d895-fbb9-418c-a29a-6988b3992d10 on hv-cinder-82497 Jan 28 01:57:39.981912 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-2645e29b-af01-4b74-85d4-f1c2863e8bc6 req-5bddc3a6-1b8b-41fb-9bc0-2d1bb18946bf service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.066175 Jan 28 01:57:39.983217 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 80/155] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:40.092011 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b95696e8-eb32-43b8-8928-9f7a3b6e9146 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:40.101845 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-13bdcc3f-8036-4eac-96d9-97d67a692fe4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:40.102918 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-13bdcc3f-8036-4eac-96d9-97d67a692fe4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:40.109229 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b95696e8-eb32-43b8-8928-9f7a3b6e9146 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.491580 Jan 28 01:57:40.110905 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 76/156] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:39 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:40.111652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13bdcc3f-8036-4eac-96d9-97d67a692fe4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:40.112471 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13bdcc3f-8036-4eac-96d9-97d67a692fe4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:40.114142 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13bdcc3f-8036-4eac-96d9-97d67a692fe4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:40.115038 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13bdcc3f-8036-4eac-96d9-97d67a692fe4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:40.258417 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-064161cd-d605-4875-874f-66a38c73aa4f tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:40.262359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-064161cd-d605-4875-874f-66a38c73aa4f tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:40.276474 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-064161cd-d605-4875-874f-66a38c73aa4f tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:40.276952 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-064161cd-d605-4875-874f-66a38c73aa4f tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:40.284507 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-064161cd-d605-4875-874f-66a38c73aa4f tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:40.285263 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-064161cd-d605-4875-874f-66a38c73aa4f tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:40.752155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-13bdcc3f-8036-4eac-96d9-97d67a692fe4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:40.763772 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-13bdcc3f-8036-4eac-96d9-97d67a692fe4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.663823 Jan 28 01:57:40.764826 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 81/157] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:40 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:40.858506 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-47a61cae-0922-41ab-9699-2cb752bd4338 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:40.859432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-47a61cae-0922-41ab-9699-2cb752bd4338 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:40.872932 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-47a61cae-0922-41ab-9699-2cb752bd4338 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:40.873274 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-47a61cae-0922-41ab-9699-2cb752bd4338 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:40.874081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-47a61cae-0922-41ab-9699-2cb752bd4338 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:40.874525 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-47a61cae-0922-41ab-9699-2cb752bd4338 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:40.995448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-47a61cae-0922-41ab-9699-2cb752bd4338 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.140752 Jan 28 01:57:40.996717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 82/158] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:40 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:41.000791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-064161cd-d605-4875-874f-66a38c73aa4f tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:41.013657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-064161cd-d605-4875-874f-66a38c73aa4f tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1315 microversion: 2.1 time: 0.758770 Jan 28 01:57:41.025182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 77/159] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:40 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:41.163156 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-52ed8b41-fc4b-4924-ae3e-6f93eef0519f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:41.167573 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-52ed8b41-fc4b-4924-ae3e-6f93eef0519f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:41.193799 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52ed8b41-fc4b-4924-ae3e-6f93eef0519f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:41.194782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52ed8b41-fc4b-4924-ae3e-6f93eef0519f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:41.196035 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52ed8b41-fc4b-4924-ae3e-6f93eef0519f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:41.196763 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52ed8b41-fc4b-4924-ae3e-6f93eef0519f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:41.419827 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-52ed8b41-fc4b-4924-ae3e-6f93eef0519f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:41.429373 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-52ed8b41-fc4b-4924-ae3e-6f93eef0519f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.303417 Jan 28 01:57:41.434430 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 83/160] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:41 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:41.780608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ceaeed1a-e8b5-4a36-958d-6fd7a094c968 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:41.781513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ceaeed1a-e8b5-4a36-958d-6fd7a094c968 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:41.792245 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ceaeed1a-e8b5-4a36-958d-6fd7a094c968 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:41.793034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ceaeed1a-e8b5-4a36-958d-6fd7a094c968 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:41.795828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ceaeed1a-e8b5-4a36-958d-6fd7a094c968 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:41.797058 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ceaeed1a-e8b5-4a36-958d-6fd7a094c968 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:42.006508 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2eaf619a-33a3-4bd5-a36c-0843034729d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:42.007516 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2eaf619a-33a3-4bd5-a36c-0843034729d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:42.008712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ceaeed1a-e8b5-4a36-958d-6fd7a094c968 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:42.017206 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ceaeed1a-e8b5-4a36-958d-6fd7a094c968 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.240522 Jan 28 01:57:42.018693 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 78/161] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:41 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:42.020741 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2eaf619a-33a3-4bd5-a36c-0843034729d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:42.021775 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2eaf619a-33a3-4bd5-a36c-0843034729d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:42.023077 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2eaf619a-33a3-4bd5-a36c-0843034729d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:42.023577 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2eaf619a-33a3-4bd5-a36c-0843034729d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:42.037496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1440b304-7977-44b7-b65a-7501774427c1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:42.055316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1440b304-7977-44b7-b65a-7501774427c1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:42.072823 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1440b304-7977-44b7-b65a-7501774427c1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:42.078503 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1440b304-7977-44b7-b65a-7501774427c1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:42.080497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1440b304-7977-44b7-b65a-7501774427c1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:42.083171 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1440b304-7977-44b7-b65a-7501774427c1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:42.228335 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2eaf619a-33a3-4bd5-a36c-0843034729d1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.224799 Jan 28 01:57:42.230215 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 84/162] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:42 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:42.382040 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1440b304-7977-44b7-b65a-7501774427c1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:42.393289 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1440b304-7977-44b7-b65a-7501774427c1 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1501 microversion: 2.1 time: 0.359993 Jan 28 01:57:42.394881 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 79/163] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:42 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1501 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:42.450431 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4ca6ed8e-647c-46ab-9327-e65e29ae16ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:42.451386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4ca6ed8e-647c-46ab-9327-e65e29ae16ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:42.462866 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ca6ed8e-647c-46ab-9327-e65e29ae16ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:42.468112 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ca6ed8e-647c-46ab-9327-e65e29ae16ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:42.469207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ca6ed8e-647c-46ab-9327-e65e29ae16ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:42.469711 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ca6ed8e-647c-46ab-9327-e65e29ae16ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:42.838537 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4ca6ed8e-647c-46ab-9327-e65e29ae16ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:42.850198 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4ca6ed8e-647c-46ab-9327-e65e29ae16ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1318 microversion: 2.1 time: 0.403746 Jan 28 01:57:42.860930 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 85/164] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:42 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:43.038163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-680f6175-2572-4b58-8da9-820ce070bf96 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:43.042286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-680f6175-2572-4b58-8da9-820ce070bf96 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:43.056659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-680f6175-2572-4b58-8da9-820ce070bf96 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:43.062310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-680f6175-2572-4b58-8da9-820ce070bf96 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:43.063308 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-680f6175-2572-4b58-8da9-820ce070bf96 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:43.063790 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-680f6175-2572-4b58-8da9-820ce070bf96 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:43.252985 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-893bd1eb-eaa4-4c4e-b9a8-57518643374b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:43.254752 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-893bd1eb-eaa4-4c4e-b9a8-57518643374b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:43.271837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-893bd1eb-eaa4-4c4e-b9a8-57518643374b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:43.273782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-893bd1eb-eaa4-4c4e-b9a8-57518643374b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:43.276538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-893bd1eb-eaa4-4c4e-b9a8-57518643374b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:43.278473 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-893bd1eb-eaa4-4c4e-b9a8-57518643374b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:43.423022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-680f6175-2572-4b58-8da9-820ce070bf96 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:43.432606 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-680f6175-2572-4b58-8da9-820ce070bf96 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1322 microversion: 2.1 time: 0.398484 Jan 28 01:57:43.433232 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 80/165] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:43 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:43.547560 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-893bd1eb-eaa4-4c4e-b9a8-57518643374b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.307433 Jan 28 01:57:43.553820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 86/166] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:43 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:43.873227 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-430c4adb-0bfc-44c6-a829-764cbc0569c1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:43.875361 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-430c4adb-0bfc-44c6-a829-764cbc0569c1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:43.886694 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-430c4adb-0bfc-44c6-a829-764cbc0569c1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:43.888079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-430c4adb-0bfc-44c6-a829-764cbc0569c1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:43.890619 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-430c4adb-0bfc-44c6-a829-764cbc0569c1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:43.892185 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-430c4adb-0bfc-44c6-a829-764cbc0569c1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.073618 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-430c4adb-0bfc-44c6-a829-764cbc0569c1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:44.082608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-430c4adb-0bfc-44c6-a829-764cbc0569c1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1508 microversion: 2.1 time: 0.216724 Jan 28 01:57:44.083322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 81/167] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:43 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:44.222310 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dec85c1d-58ac-4c0d-b9e9-54bb1a2e1a02 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c23bd8ee-2620-4a3d-bf2f-71daddc1dd87"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:44.223517 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dec85c1d-58ac-4c0d-b9e9-54bb1a2e1a02 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:44.231219 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dec85c1d-58ac-4c0d-b9e9-54bb1a2e1a02 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:44.232122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dec85c1d-58ac-4c0d-b9e9-54bb1a2e1a02 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.234138 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dec85c1d-58ac-4c0d-b9e9-54bb1a2e1a02 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:44.235075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dec85c1d-58ac-4c0d-b9e9-54bb1a2e1a02 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.451210 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6b187b2f-d3be-489a-bbb3-d558b696c784 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:44.452589 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6b187b2f-d3be-489a-bbb3-d558b696c784 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:44.466453 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6b187b2f-d3be-489a-bbb3-d558b696c784 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:44.466892 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6b187b2f-d3be-489a-bbb3-d558b696c784 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.473032 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6b187b2f-d3be-489a-bbb3-d558b696c784 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:44.473601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6b187b2f-d3be-489a-bbb3-d558b696c784 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.739151 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6b187b2f-d3be-489a-bbb3-d558b696c784 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:44.751162 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dec85c1d-58ac-4c0d-b9e9-54bb1a2e1a02 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "POST /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532702 Jan 28 01:57:44.751810 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6b187b2f-d3be-489a-bbb3-d558b696c784 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1516 microversion: 2.1 time: 0.304953 Jan 28 01:57:44.752670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 87/168] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 01:57:44 2022] POST /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:57:44.763583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 82/169] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:44 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:44.775192 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c7072e05-57ff-4e1c-b7c9-b58a5f4632a1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:44.777215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c7072e05-57ff-4e1c-b7c9-b58a5f4632a1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:44.778360 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dcfc7f2e-46de-4df8-839d-1fbe6fd46cf1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:44.781377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dcfc7f2e-46de-4df8-839d-1fbe6fd46cf1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:44.785868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c7072e05-57ff-4e1c-b7c9-b58a5f4632a1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:44.786380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c7072e05-57ff-4e1c-b7c9-b58a5f4632a1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.787912 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c7072e05-57ff-4e1c-b7c9-b58a5f4632a1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:44.788767 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c7072e05-57ff-4e1c-b7c9-b58a5f4632a1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.797138 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dcfc7f2e-46de-4df8-839d-1fbe6fd46cf1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:44.797593 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dcfc7f2e-46de-4df8-839d-1fbe6fd46cf1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.798386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dcfc7f2e-46de-4df8-839d-1fbe6fd46cf1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:44.798817 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dcfc7f2e-46de-4df8-839d-1fbe6fd46cf1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:44.873046 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-c7072e05-57ff-4e1c-b7c9-b58a5f4632a1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lazy-loading 'flavor' on Instance uuid c4d2d895-fbb9-418c-a29a-6988b3992d10 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:57:44.985584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dcfc7f2e-46de-4df8-839d-1fbe6fd46cf1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.231145 Jan 28 01:57:44.986997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 88/170] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:44 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:45.071289 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c7072e05-57ff-4e1c-b7c9-b58a5f4632a1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10/action" status: 200 len: 32 microversion: 2.1 time: 0.304306 Jan 28 01:57:45.072142 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 83/171] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 01:57:44 2022] POST /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:57:45.081736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8cc93414-b517-4372-97f9-2dbd48d356df tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:45.082533 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8cc93414-b517-4372-97f9-2dbd48d356df tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:45.091700 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cc93414-b517-4372-97f9-2dbd48d356df tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:45.093680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cc93414-b517-4372-97f9-2dbd48d356df tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:45.099300 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cc93414-b517-4372-97f9-2dbd48d356df tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:45.100270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cc93414-b517-4372-97f9-2dbd48d356df tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:45.534229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8cc93414-b517-4372-97f9-2dbd48d356df tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:45.551368 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8cc93414-b517-4372-97f9-2dbd48d356df tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.472371 Jan 28 01:57:45.555847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 89/172] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:45 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:45.859571 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2435e048-fb93-46fe-ab11-79397e58c633 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "832f208b-b47d-4674-9891-2a0836ae10f3"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:45.861847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2435e048-fb93-46fe-ab11-79397e58c633 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:45.868547 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2435e048-fb93-46fe-ab11-79397e58c633 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:45.869306 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2435e048-fb93-46fe-ab11-79397e58c633 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:45.870644 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2435e048-fb93-46fe-ab11-79397e58c633 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:45.871303 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2435e048-fb93-46fe-ab11-79397e58c633 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:45.997776 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-858a205d-ded6-4e35-9def-b4c873aa9ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:45.999217 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-858a205d-ded6-4e35-9def-b4c873aa9ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:46.009306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-858a205d-ded6-4e35-9def-b4c873aa9ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:46.009995 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-858a205d-ded6-4e35-9def-b4c873aa9ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:46.012250 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-858a205d-ded6-4e35-9def-b4c873aa9ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:46.012677 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-858a205d-ded6-4e35-9def-b4c873aa9ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:46.208947 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-858a205d-ded6-4e35-9def-b4c873aa9ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.214068 Jan 28 01:57:46.210482 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 90/173] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:45 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:46.398091 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2435e048-fb93-46fe-ab11-79397e58c633 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542918 Jan 28 01:57:46.399749 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 84/174] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 01:57:45 2022] POST /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:46.587368 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1128c992-56aa-4a29-ba70-8e2146dd739d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:46.597017 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1128c992-56aa-4a29-ba70-8e2146dd739d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:46.625531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1128c992-56aa-4a29-ba70-8e2146dd739d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:46.626012 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1128c992-56aa-4a29-ba70-8e2146dd739d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:46.628176 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1128c992-56aa-4a29-ba70-8e2146dd739d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:46.628638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1128c992-56aa-4a29-ba70-8e2146dd739d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:46.914305 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1128c992-56aa-4a29-ba70-8e2146dd739d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:46.941108 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1128c992-56aa-4a29-ba70-8e2146dd739d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.369514 Jan 28 01:57:46.944741 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 91/175] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:46 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:47.231004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-882a3647-ced5-4889-8152-d11505be649e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:47.237648 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-882a3647-ced5-4889-8152-d11505be649e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:47.256887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-882a3647-ced5-4889-8152-d11505be649e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:47.257309 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-882a3647-ced5-4889-8152-d11505be649e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:47.258098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-882a3647-ced5-4889-8152-d11505be649e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:47.258541 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-882a3647-ced5-4889-8152-d11505be649e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:47.383295 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-882a3647-ced5-4889-8152-d11505be649e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.164776 Jan 28 01:57:47.384687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 85/176] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:47 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:47.963359 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9dadde7d-d19d-49aa-8c33-84026caf3662 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:47.966612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9dadde7d-d19d-49aa-8c33-84026caf3662 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:47.977594 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dadde7d-d19d-49aa-8c33-84026caf3662 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:47.978311 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dadde7d-d19d-49aa-8c33-84026caf3662 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:47.979594 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dadde7d-d19d-49aa-8c33-84026caf3662 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:47.980564 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dadde7d-d19d-49aa-8c33-84026caf3662 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:48.307330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9dadde7d-d19d-49aa-8c33-84026caf3662 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:48.329469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9dadde7d-d19d-49aa-8c33-84026caf3662 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.367007 Jan 28 01:57:48.330148 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 92/177] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:47 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:48.406962 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-df6a8232-686b-4912-bddc-f671bd9c4eb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:48.409923 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-df6a8232-686b-4912-bddc-f671bd9c4eb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:48.425549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-df6a8232-686b-4912-bddc-f671bd9c4eb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:48.428004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-df6a8232-686b-4912-bddc-f671bd9c4eb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:48.429649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-df6a8232-686b-4912-bddc-f671bd9c4eb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:48.430368 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-df6a8232-686b-4912-bddc-f671bd9c4eb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:48.547768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-df6a8232-686b-4912-bddc-f671bd9c4eb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.153974 Jan 28 01:57:48.548678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 86/178] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:48 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:49.348200 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bef4c656-3730-4041-a39c-046d5a47c762 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:49.349561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bef4c656-3730-4041-a39c-046d5a47c762 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:49.362486 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bef4c656-3730-4041-a39c-046d5a47c762 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:49.364101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bef4c656-3730-4041-a39c-046d5a47c762 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:49.368734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bef4c656-3730-4041-a39c-046d5a47c762 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:49.369607 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bef4c656-3730-4041-a39c-046d5a47c762 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:49.568984 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2a3aef5c-cd6e-4667-b4a0-333440bb9602 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:49.573943 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2a3aef5c-cd6e-4667-b4a0-333440bb9602 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:49.595619 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a3aef5c-cd6e-4667-b4a0-333440bb9602 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:49.596407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a3aef5c-cd6e-4667-b4a0-333440bb9602 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:49.611190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a3aef5c-cd6e-4667-b4a0-333440bb9602 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:49.612289 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a3aef5c-cd6e-4667-b4a0-333440bb9602 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:49.640505 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bef4c656-3730-4041-a39c-046d5a47c762 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:49.652991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bef4c656-3730-4041-a39c-046d5a47c762 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.307467 Jan 28 01:57:49.664778 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 93/179] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:49 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:49.822996 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2a3aef5c-cd6e-4667-b4a0-333440bb9602 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.263141 Jan 28 01:57:49.824131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 87/180] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:49 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:50.692079 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b5ff9f3b-8ed1-463e-834c-7e358c0cf15b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:50.692899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b5ff9f3b-8ed1-463e-834c-7e358c0cf15b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:50.707203 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5ff9f3b-8ed1-463e-834c-7e358c0cf15b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:50.709795 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5ff9f3b-8ed1-463e-834c-7e358c0cf15b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:50.710810 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5ff9f3b-8ed1-463e-834c-7e358c0cf15b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:50.712555 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5ff9f3b-8ed1-463e-834c-7e358c0cf15b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:50.850054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-68b41222-afa1-483c-a361-7932b3b8138b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:50.852887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-68b41222-afa1-483c-a361-7932b3b8138b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:50.866356 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68b41222-afa1-483c-a361-7932b3b8138b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:50.867166 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68b41222-afa1-483c-a361-7932b3b8138b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:50.869253 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68b41222-afa1-483c-a361-7932b3b8138b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:50.873493 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68b41222-afa1-483c-a361-7932b3b8138b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:51.055356 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-68b41222-afa1-483c-a361-7932b3b8138b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 14 microversion: 2.20 time: 0.220713 Jan 28 01:57:51.056980 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 88/181] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:50 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:51.061977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b5ff9f3b-8ed1-463e-834c-7e358c0cf15b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:51.069779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b5ff9f3b-8ed1-463e-834c-7e358c0cf15b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.390986 Jan 28 01:57:51.073030 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 94/182] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:50 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:52.075766 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f341cafe-57a7-4fa3-979c-68d141c99b94 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:52.076860 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f341cafe-57a7-4fa3-979c-68d141c99b94 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:52.087001 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0352215c-4c46-437b-902d-3361003f8a87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:52.088646 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0352215c-4c46-437b-902d-3361003f8a87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:52.110725 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0352215c-4c46-437b-902d-3361003f8a87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:52.111184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0352215c-4c46-437b-902d-3361003f8a87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:52.112036 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0352215c-4c46-437b-902d-3361003f8a87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:52.112469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0352215c-4c46-437b-902d-3361003f8a87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:52.120154 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f341cafe-57a7-4fa3-979c-68d141c99b94 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:52.120669 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f341cafe-57a7-4fa3-979c-68d141c99b94 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:52.121494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f341cafe-57a7-4fa3-979c-68d141c99b94 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:52.121931 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f341cafe-57a7-4fa3-979c-68d141c99b94 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:52.349118 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f341cafe-57a7-4fa3-979c-68d141c99b94 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 6451 microversion: 2.20 time: 0.285477 Jan 28 01:57:52.350112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 89/183] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:52 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 6451 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:57:52.482350 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0352215c-4c46-437b-902d-3361003f8a87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:52.491047 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0352215c-4c46-437b-902d-3361003f8a87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.407652 Jan 28 01:57:52.491625 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 95/184] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:52 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:53.363771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a279ce34-1113-400a-aa86-90da69344da5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:53.376023 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a279ce34-1113-400a-aa86-90da69344da5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:53.407352 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a279ce34-1113-400a-aa86-90da69344da5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:53.407820 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a279ce34-1113-400a-aa86-90da69344da5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:53.418532 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a279ce34-1113-400a-aa86-90da69344da5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:53.423368 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a279ce34-1113-400a-aa86-90da69344da5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:53.510661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-956c23c0-a6f7-4634-8ff8-5f407993d9f1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:53.511966 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-956c23c0-a6f7-4634-8ff8-5f407993d9f1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:53.525324 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-956c23c0-a6f7-4634-8ff8-5f407993d9f1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:53.526306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-956c23c0-a6f7-4634-8ff8-5f407993d9f1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:53.527918 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-956c23c0-a6f7-4634-8ff8-5f407993d9f1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:53.528558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-956c23c0-a6f7-4634-8ff8-5f407993d9f1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:53.601743 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a279ce34-1113-400a-aa86-90da69344da5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 11132 microversion: 2.20 time: 0.244882 Jan 28 01:57:53.608708 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 90/185] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:53 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 11132 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:57:53.908034 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-956c23c0-a6f7-4634-8ff8-5f407993d9f1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:53.915663 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-956c23c0-a6f7-4634-8ff8-5f407993d9f1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.409591 Jan 28 01:57:53.929687 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 96/186] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:53 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:54.078073 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e68c9351-61ed-4d24-b331-ced18fd9430e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:54.078643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e68c9351-61ed-4d24-b331-ced18fd9430e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:54.086597 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e68c9351-61ed-4d24-b331-ced18fd9430e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:54.087649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e68c9351-61ed-4d24-b331-ced18fd9430e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:54.089011 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e68c9351-61ed-4d24-b331-ced18fd9430e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:54.089958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e68c9351-61ed-4d24-b331-ced18fd9430e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:54.170832 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e68c9351-61ed-4d24-b331-ced18fd9430e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 01:57:54.368229 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e68c9351-61ed-4d24-b331-ced18fd9430e tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "DELETE /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 204 len: 0 microversion: 2.1 time: 0.294205 Jan 28 01:57:54.376915 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 91/187] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 01:57:54 2022] DELETE /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:57:54.381642 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e7f5eb12-dead-4bc5-a493-5f89e93a4550 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:54.382478 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e7f5eb12-dead-4bc5-a493-5f89e93a4550 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:54.393395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7f5eb12-dead-4bc5-a493-5f89e93a4550 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:54.393841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7f5eb12-dead-4bc5-a493-5f89e93a4550 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:54.394641 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7f5eb12-dead-4bc5-a493-5f89e93a4550 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:54.395085 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7f5eb12-dead-4bc5-a493-5f89e93a4550 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:54.616722 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7ba3e977-b540-474c-9969-0c3d0854f0cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:54.618453 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7ba3e977-b540-474c-9969-0c3d0854f0cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:54.637563 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ba3e977-b540-474c-9969-0c3d0854f0cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:54.638035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ba3e977-b540-474c-9969-0c3d0854f0cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:54.645270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ba3e977-b540-474c-9969-0c3d0854f0cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:54.645727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ba3e977-b540-474c-9969-0c3d0854f0cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:54.719194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e7f5eb12-dead-4bc5-a493-5f89e93a4550 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:54.737909 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e7f5eb12-dead-4bc5-a493-5f89e93a4550 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1553 microversion: 2.1 time: 0.359931 Jan 28 01:57:54.752058 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 97/188] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:54 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1553 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:54.816035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7ba3e977-b540-474c-9969-0c3d0854f0cd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 15064 microversion: 2.20 time: 0.203862 Jan 28 01:57:54.819699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 92/189] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:54 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 15064 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:57:54.943424 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9719c4a7-40d5-46e7-bdc6-948832086c23 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:54.944458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9719c4a7-40d5-46e7-bdc6-948832086c23 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:54.956462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9719c4a7-40d5-46e7-bdc6-948832086c23 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:54.957365 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9719c4a7-40d5-46e7-bdc6-948832086c23 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:54.960055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9719c4a7-40d5-46e7-bdc6-948832086c23 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:54.961047 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9719c4a7-40d5-46e7-bdc6-948832086c23 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:55.139371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9719c4a7-40d5-46e7-bdc6-948832086c23 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:55.148743 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9719c4a7-40d5-46e7-bdc6-948832086c23 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.215033 Jan 28 01:57:55.161189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 98/190] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:54 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:55.760669 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3b132d17-ea06-481a-8bf1-d2e209a61254 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:55.762037 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3b132d17-ea06-481a-8bf1-d2e209a61254 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:55.777948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b132d17-ea06-481a-8bf1-d2e209a61254 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:55.778724 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b132d17-ea06-481a-8bf1-d2e209a61254 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:55.779924 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b132d17-ea06-481a-8bf1-d2e209a61254 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:55.780958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b132d17-ea06-481a-8bf1-d2e209a61254 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:55.832389 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a3daab40-bc29-4cac-82f4-d56754a886a4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:55.833726 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a3daab40-bc29-4cac-82f4-d56754a886a4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:55.840041 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3daab40-bc29-4cac-82f4-d56754a886a4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:55.840499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3daab40-bc29-4cac-82f4-d56754a886a4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:55.841452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3daab40-bc29-4cac-82f4-d56754a886a4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:55.841717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3daab40-bc29-4cac-82f4-d56754a886a4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:56.023275 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a3daab40-bc29-4cac-82f4-d56754a886a4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 17325 microversion: 2.20 time: 0.199122 Jan 28 01:57:56.024571 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 99/191] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:55 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 17325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:57:56.032737 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3b132d17-ea06-481a-8bf1-d2e209a61254 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:56.046510 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3b132d17-ea06-481a-8bf1-d2e209a61254 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1553 microversion: 2.1 time: 0.290401 Jan 28 01:57:56.047037 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 93/192] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:55 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1553 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:56.176906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fb77fc49-5d55-487a-a1e9-b78452a2c8f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:56.178407 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fb77fc49-5d55-487a-a1e9-b78452a2c8f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:56.190895 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb77fc49-5d55-487a-a1e9-b78452a2c8f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:56.192891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb77fc49-5d55-487a-a1e9-b78452a2c8f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:56.194105 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb77fc49-5d55-487a-a1e9-b78452a2c8f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:56.194690 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb77fc49-5d55-487a-a1e9-b78452a2c8f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:56.384635 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fb77fc49-5d55-487a-a1e9-b78452a2c8f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:56.399369 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fb77fc49-5d55-487a-a1e9-b78452a2c8f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.233811 Jan 28 01:57:56.401442 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 100/193] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:56 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:57.037775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-58750734-f701-4a33-ab63-1feb0c9c2e73 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:57.039703 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-58750734-f701-4a33-ab63-1feb0c9c2e73 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:57.047094 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58750734-f701-4a33-ab63-1feb0c9c2e73 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:57.048006 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58750734-f701-4a33-ab63-1feb0c9c2e73 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:57.049181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58750734-f701-4a33-ab63-1feb0c9c2e73 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:57.049848 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58750734-f701-4a33-ab63-1feb0c9c2e73 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:57.066142 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bf2aabfb-9169-4957-859b-3a3595116f31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:57.067462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bf2aabfb-9169-4957-859b-3a3595116f31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:57.078745 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2aabfb-9169-4957-859b-3a3595116f31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:57.080817 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2aabfb-9169-4957-859b-3a3595116f31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:57.082190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2aabfb-9169-4957-859b-3a3595116f31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:57.083163 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2aabfb-9169-4957-859b-3a3595116f31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:57.281496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-58750734-f701-4a33-ab63-1feb0c9c2e73 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 17686 microversion: 2.20 time: 0.249153 Jan 28 01:57:57.282391 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 94/194] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:57 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 17686 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:57:57.328847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bf2aabfb-9169-4957-859b-3a3595116f31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:57.339096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bf2aabfb-9169-4957-859b-3a3595116f31 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1553 microversion: 2.1 time: 0.278185 Jan 28 01:57:57.354993 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 101/195] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:57 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:57.428881 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5e1a4f2f-da65-425d-abcf-c0f84a62b0ed tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:57.429997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5e1a4f2f-da65-425d-abcf-c0f84a62b0ed tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:57.440416 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e1a4f2f-da65-425d-abcf-c0f84a62b0ed tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:57.441348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e1a4f2f-da65-425d-abcf-c0f84a62b0ed tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:57.442349 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e1a4f2f-da65-425d-abcf-c0f84a62b0ed tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:57.443188 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e1a4f2f-da65-425d-abcf-c0f84a62b0ed tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:57.749215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5e1a4f2f-da65-425d-abcf-c0f84a62b0ed tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:57.759018 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5e1a4f2f-da65-425d-abcf-c0f84a62b0ed tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.341021 Jan 28 01:57:57.759633 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 95/196] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:57 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:58.294229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1d534d91-845e-4c62-b8c3-155977b39bb1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:58.296880 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1d534d91-845e-4c62-b8c3-155977b39bb1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:58.309952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d534d91-845e-4c62-b8c3-155977b39bb1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:58.310730 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d534d91-845e-4c62-b8c3-155977b39bb1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:58.311891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d534d91-845e-4c62-b8c3-155977b39bb1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:58.312428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d534d91-845e-4c62-b8c3-155977b39bb1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:58.356978 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8778057c-497d-4d5f-a73c-a0b69e6fb73d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:58.358210 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8778057c-497d-4d5f-a73c-a0b69e6fb73d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:58.370299 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8778057c-497d-4d5f-a73c-a0b69e6fb73d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:58.376401 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8778057c-497d-4d5f-a73c-a0b69e6fb73d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:58.377491 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8778057c-497d-4d5f-a73c-a0b69e6fb73d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:58.379127 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8778057c-497d-4d5f-a73c-a0b69e6fb73d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:58.476194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1d534d91-845e-4c62-b8c3-155977b39bb1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 19342 microversion: 2.20 time: 0.185820 Jan 28 01:57:58.477176 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 102/197] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:58 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 19342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:57:58.590163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8778057c-497d-4d5f-a73c-a0b69e6fb73d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:58.602029 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8778057c-497d-4d5f-a73c-a0b69e6fb73d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1553 microversion: 2.1 time: 0.249966 Jan 28 01:57:58.603168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 96/198] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:58 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:57:58.780016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d7c19417-343d-4816-8628-a037d1a3a94a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:58.781989 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d7c19417-343d-4816-8628-a037d1a3a94a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:58.792906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7c19417-343d-4816-8628-a037d1a3a94a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:58.793822 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7c19417-343d-4816-8628-a037d1a3a94a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:58.794803 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7c19417-343d-4816-8628-a037d1a3a94a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:58.796210 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7c19417-343d-4816-8628-a037d1a3a94a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:58.932077 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-d18d153a-912b-4015-8c26-7426316df4dd req-f685b16b-02e4-49a6-a158-fa8bb98e5a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93ca8fd-3477-43fa-9d41-56e66cb51528", "name": "network-vif-deleted", "tag": "e841332d-7cf8-4dbd-bfef-9a71a9c23148"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:58.933865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:58.933865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:57:58.947846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d18d153a-912b-4015-8c26-7426316df4dd req-f685b16b-02e4-49a6-a158-fa8bb98e5a03 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:58.949480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d18d153a-912b-4015-8c26-7426316df4dd req-f685b16b-02e4-49a6-a158-fa8bb98e5a03 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:59.005863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-d18d153a-912b-4015-8c26-7426316df4dd req-f685b16b-02e4-49a6-a158-fa8bb98e5a03 service nova] Creating event network-vif-deleted:e841332d-7cf8-4dbd-bfef-9a71a9c23148 for instance a93ca8fd-3477-43fa-9d41-56e66cb51528 on hv-cinder-82497 Jan 28 01:57:59.020971 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-d18d153a-912b-4015-8c26-7426316df4dd req-f685b16b-02e4-49a6-a158-fa8bb98e5a03 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085606 Jan 28 01:57:59.029090 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 97/199] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:57:59.134237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d7c19417-343d-4816-8628-a037d1a3a94a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:59.144247 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d7c19417-343d-4816-8628-a037d1a3a94a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.372224 Jan 28 01:57:59.145445 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 103/200] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:58 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:57:59.488300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a7e11f8b-ac9b-4f6f-9d43-773409f23a6e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:57:59.489472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a7e11f8b-ac9b-4f6f-9d43-773409f23a6e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:59.510435 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7e11f8b-ac9b-4f6f-9d43-773409f23a6e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:59.510995 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7e11f8b-ac9b-4f6f-9d43-773409f23a6e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:59.512001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7e11f8b-ac9b-4f6f-9d43-773409f23a6e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:59.512437 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7e11f8b-ac9b-4f6f-9d43-773409f23a6e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:59.632874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:57:59.638380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:57:59.679074 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:59.680298 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:59.681410 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:59.683987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:59.756638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:57:59.757426 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:57:59.758289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lazy-loading 'fault' on Instance uuid a93ca8fd-3477-43fa-9d41-56e66cb51528 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:57:59.762526 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a7e11f8b-ac9b-4f6f-9d43-773409f23a6e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 20991 microversion: 2.20 time: 0.277302 Jan 28 01:57:59.763324 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 98/201] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:57:59 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 20991 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:57:59.927022 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62a8866a5dd404cbc333c640d85e6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0aef26837b47059522707fb2ce8422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:57:59.935088 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3ab0d3a5-b603-48c7-bc45-ad5e77935cf8 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 200 len: 1351 microversion: 2.1 time: 0.318516 Jan 28 01:57:59.945293 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 104/202] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:57:59 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 1351 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:00.165088 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d5aa6136-ad32-4444-af7a-2254575c1de1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:00.165770 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d5aa6136-ad32-4444-af7a-2254575c1de1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:00.189413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5aa6136-ad32-4444-af7a-2254575c1de1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:00.189413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5aa6136-ad32-4444-af7a-2254575c1de1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:00.189413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5aa6136-ad32-4444-af7a-2254575c1de1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:00.189413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5aa6136-ad32-4444-af7a-2254575c1de1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:00.611288 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d5aa6136-ad32-4444-af7a-2254575c1de1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:00.629900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d5aa6136-ad32-4444-af7a-2254575c1de1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.468849 Jan 28 01:58:00.630833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 99/203] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:00 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:00.786769 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-688a61ef-93bd-4406-aec9-6a78aecc394f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:00.787469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-688a61ef-93bd-4406-aec9-6a78aecc394f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:00.800781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-688a61ef-93bd-4406-aec9-6a78aecc394f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:00.801273 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-688a61ef-93bd-4406-aec9-6a78aecc394f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:00.802185 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-688a61ef-93bd-4406-aec9-6a78aecc394f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:00.802736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-688a61ef-93bd-4406-aec9-6a78aecc394f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:00.968089 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:00.968739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:00.978959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:00.985552 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:00.988912 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:00.991823 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:01.019052 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-688a61ef-93bd-4406-aec9-6a78aecc394f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 21964 microversion: 2.20 time: 0.246304 Jan 28 01:58:01.021728 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 105/204] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:00 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 21964 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:01.043023 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] HTTP exception thrown: Instance a93ca8fd-3477-43fa-9d41-56e66cb51528 could not be found. Jan 28 01:58:01.045627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Returning 404 to user: Instance a93ca8fd-3477-43fa-9d41-56e66cb51528 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:58:01.048621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a596d07f-ec40-4143-ae8a-0d31657d5114 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 404 len: 111 microversion: 2.1 time: 0.083609 Jan 28 01:58:01.050588 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 100/205] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:00 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:58:01.327724 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:01.328956 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:01.339846 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:01.343303 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:01.349600 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:01.353772 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:01.394518 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] HTTP exception thrown: Instance a93ca8fd-3477-43fa-9d41-56e66cb51528 could not be found. Jan 28 01:58:01.395410 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Returning 404 to user: Instance a93ca8fd-3477-43fa-9d41-56e66cb51528 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:58:01.396869 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c4a0ef0e-7d3f-44fc-a126-d41de7ae1f9c tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073462 Jan 28 01:58:01.398035 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 106/206] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:58:01 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528/os-volume_attachments => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:58:01.647701 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eeee5fef-bba6-487a-ada1-cfe8694014a7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:01.648331 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-eeee5fef-bba6-487a-ada1-cfe8694014a7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:01.666521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eeee5fef-bba6-487a-ada1-cfe8694014a7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:01.667881 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eeee5fef-bba6-487a-ada1-cfe8694014a7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:01.675646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eeee5fef-bba6-487a-ada1-cfe8694014a7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:01.676127 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eeee5fef-bba6-487a-ada1-cfe8694014a7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:02.031124 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c66561c4-7a4a-4eda-b153-5568684e9c5b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:02.032916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c66561c4-7a4a-4eda-b153-5568684e9c5b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:02.043849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c66561c4-7a4a-4eda-b153-5568684e9c5b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:02.048653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c66561c4-7a4a-4eda-b153-5568684e9c5b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:02.049552 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c66561c4-7a4a-4eda-b153-5568684e9c5b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:02.050002 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c66561c4-7a4a-4eda-b153-5568684e9c5b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:02.188613 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-eeee5fef-bba6-487a-ada1-cfe8694014a7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:02.203678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-eeee5fef-bba6-487a-ada1-cfe8694014a7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.559446 Jan 28 01:58:02.221558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c66561c4-7a4a-4eda-b153-5568684e9c5b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 22889 microversion: 2.20 time: 0.194036 Jan 28 01:58:02.222981 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 107/207] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:02 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 22889 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:02.229769 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 101/208] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:01 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:02.976509 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:02.977179 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:02.986697 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:02.987333 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:02.988270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:02.988911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:03.006833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] HTTP exception thrown: Instance a93ca8fd-3477-43fa-9d41-56e66cb51528 could not be found. Jan 28 01:58:03.007498 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Returning 404 to user: Instance a93ca8fd-3477-43fa-9d41-56e66cb51528 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:58:03.008377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b6882069-9910-4b93-a913-5ef357d0b705 tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "DELETE /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 404 len: 111 microversion: 2.1 time: 0.037037 Jan 28 01:58:03.009534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 108/209] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 01:58:02 2022] DELETE /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:58:03.018713 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:03.020756 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] [instance: a93ca8fd-3477-43fa-9d41-56e66cb51528] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:03.035058 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:03.035517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:03.036321 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:03.039957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:03.072225 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] HTTP exception thrown: Instance a93ca8fd-3477-43fa-9d41-56e66cb51528 could not be found. Jan 28 01:58:03.074619 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] Returning 404 to user: Instance a93ca8fd-3477-43fa-9d41-56e66cb51528 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:58:03.076010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4e49181f-9555-4900-9036-23020da1d45d tempest-DeleteServersTestJSON-731672046 tempest-DeleteServersTestJSON-731672046-project] 10.222.0.96 "GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528" status: 404 len: 111 microversion: 2.1 time: 0.062448 Jan 28 01:58:03.078797 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 102/210] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:03 2022] GET /compute/v2.1/servers/a93ca8fd-3477-43fa-9d41-56e66cb51528 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:58:03.234627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d9fea410-25a2-4ca9-b26a-ddd5bbd52295 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:03.235725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d9fea410-25a2-4ca9-b26a-ddd5bbd52295 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:03.246668 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9fea410-25a2-4ca9-b26a-ddd5bbd52295 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:03.247259 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9fea410-25a2-4ca9-b26a-ddd5bbd52295 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:03.248509 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9fea410-25a2-4ca9-b26a-ddd5bbd52295 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:03.250960 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9fea410-25a2-4ca9-b26a-ddd5bbd52295 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:03.432818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d9fea410-25a2-4ca9-b26a-ddd5bbd52295 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 23224 microversion: 2.20 time: 0.202619 Jan 28 01:58:03.434115 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 103/211] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:03 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 23224 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:03.446897 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d4969bd6-d563-45a2-9fa1-5386e341d410 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:03.447901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d4969bd6-d563-45a2-9fa1-5386e341d410 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:03.461112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d4969bd6-d563-45a2-9fa1-5386e341d410 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:03.463007 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d4969bd6-d563-45a2-9fa1-5386e341d410 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:03.463991 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d4969bd6-d563-45a2-9fa1-5386e341d410 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:03.464971 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d4969bd6-d563-45a2-9fa1-5386e341d410 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:03.574577 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ef00508c-e764-4a2c-aa92-c4b65a04336e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Action: 'create', calling method: .version_select at 0x7f523f529310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-363378608"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:03.637058 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ef00508c-e764-4a2c-aa92-c4b65a04336e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for project 6e15e80496d946b4ba64c95751ebc354. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:58:03.643456 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ef00508c-e764-4a2c-aa92-c4b65a04336e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for user cd9cb4ec35524e859b828892c95130e7 and project 6e15e80496d946b4ba64c95751ebc354. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:58:03.724556 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d4969bd6-d563-45a2-9fa1-5386e341d410 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:03.732005 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d4969bd6-d563-45a2-9fa1-5386e341d410 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.296574 Jan 28 01:58:03.733691 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 104/212] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:03 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:03.745130 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1194571953", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "72255c1f-77c9-4e8a-9e7a-3b079454c5f0"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:03.815252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] validate_networks() for [('72255c1f-77c9-4e8a-9e7a-3b079454c5f0', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:58:03.945141 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ef00508c-e764-4a2c-aa92-c4b65a04336e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for project 6e15e80496d946b4ba64c95751ebc354. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:58:03.950026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ef00508c-e764-4a2c-aa92-c4b65a04336e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for user cd9cb4ec35524e859b828892c95130e7 and project 6e15e80496d946b4ba64c95751ebc354. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:58:03.976325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ef00508c-e764-4a2c-aa92-c4b65a04336e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.772975 Jan 28 01:58:03.976325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 109/213] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Jan 28 01:58:03 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:04.456478 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dd5b2b44-b651-420c-b233-de4aebe55620 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:04.457706 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd5b2b44-b651-420c-b233-de4aebe55620 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:04.522955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd5b2b44-b651-420c-b233-de4aebe55620 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:04.525359 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd5b2b44-b651-420c-b233-de4aebe55620 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:04.539884 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd5b2b44-b651-420c-b233-de4aebe55620 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:04.540631 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd5b2b44-b651-420c-b233-de4aebe55620 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:04.750258 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dd5b2b44-b651-420c-b233-de4aebe55620 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 23969 microversion: 2.20 time: 0.302105 Jan 28 01:58:04.758226 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 110/214] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:04 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 23969 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:04.769410 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cdb98887-5041-4815-a091-197b5393dd42 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:04.769962 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:58:04.770589 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cdb98887-5041-4815-a091-197b5393dd42 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:04.770722 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:58:04.770899 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:58:04.772030 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:58:04.772693 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:58:04.790493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cdb98887-5041-4815-a091-197b5393dd42 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:04.790493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cdb98887-5041-4815-a091-197b5393dd42 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:04.790493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cdb98887-5041-4815-a091-197b5393dd42 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:04.790493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cdb98887-5041-4815-a091-197b5393dd42 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:04.801211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:04.802767 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:04.804267 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:04.805110 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:04.830965 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Getting quotas for project f2f478fd06754a38b139c8415da6a514. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:58:04.836901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Getting quotas for user 1f57e62502564821b4be822554d9f5a7 and project f2f478fd06754a38b139c8415da6a514. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:58:04.857637 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:58:04.862023 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:58:04.948465 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-32a78cb7-f6ed-4218-b5fe-a7f6e9b203ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.211842 Jan 28 01:58:04.957974 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 105/215] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:58:04.968036 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ed6c5940-ed39-4cfd-bbe0-152bb0c8d7dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:04.970295 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ed6c5940-ed39-4cfd-bbe0-152bb0c8d7dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:05.134403 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ed6c5940-ed39-4cfd-bbe0-152bb0c8d7dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:05.145447 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ed6c5940-ed39-4cfd-bbe0-152bb0c8d7dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1218 microversion: 2.1 time: 0.185042 Jan 28 01:58:05.146332 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 106/216] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:04 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:05.162315 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cdb98887-5041-4815-a091-197b5393dd42 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:05.184997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cdb98887-5041-4815-a091-197b5393dd42 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.425432 Jan 28 01:58:05.197848 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 111/217] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:04 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:05.767036 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0d3d059a-a2e4-431e-ad6a-284d6991c0c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:05.768390 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0d3d059a-a2e4-431e-ad6a-284d6991c0c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:05.783516 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d3d059a-a2e4-431e-ad6a-284d6991c0c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:05.784236 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d3d059a-a2e4-431e-ad6a-284d6991c0c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:05.789243 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d3d059a-a2e4-431e-ad6a-284d6991c0c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:05.807085 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d3d059a-a2e4-431e-ad6a-284d6991c0c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:05.948526 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0d3d059a-a2e4-431e-ad6a-284d6991c0c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 24816 microversion: 2.20 time: 0.186520 Jan 28 01:58:05.949205 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 107/218] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:05 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 24816 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:06.168878 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7ea0a7db-635e-483c-ae2e-b4036a1b3587 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:06.170438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7ea0a7db-635e-483c-ae2e-b4036a1b3587 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:06.189039 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ea0a7db-635e-483c-ae2e-b4036a1b3587 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:06.190048 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ea0a7db-635e-483c-ae2e-b4036a1b3587 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:06.191205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ea0a7db-635e-483c-ae2e-b4036a1b3587 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:06.191806 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ea0a7db-635e-483c-ae2e-b4036a1b3587 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:06.208574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3e8c1412-4832-42f0-a212-12fb3152b737 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:06.209494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3e8c1412-4832-42f0-a212-12fb3152b737 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:06.232617 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e8c1412-4832-42f0-a212-12fb3152b737 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:06.234852 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e8c1412-4832-42f0-a212-12fb3152b737 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:06.236816 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e8c1412-4832-42f0-a212-12fb3152b737 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:06.238629 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e8c1412-4832-42f0-a212-12fb3152b737 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:06.372101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7ea0a7db-635e-483c-ae2e-b4036a1b3587 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:06.392030 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7ea0a7db-635e-483c-ae2e-b4036a1b3587 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1270 microversion: 2.1 time: 0.231760 Jan 28 01:58:06.398037 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 112/219] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:06 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:06.585828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3e8c1412-4832-42f0-a212-12fb3152b737 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:06.596237 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3e8c1412-4832-42f0-a212-12fb3152b737 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.393201 Jan 28 01:58:06.597785 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 108/220] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:06 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:06.960737 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ce457f4c-6a27-4c9b-af37-8399f7940209 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:06.961651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ce457f4c-6a27-4c9b-af37-8399f7940209 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:06.985989 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ce457f4c-6a27-4c9b-af37-8399f7940209 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:06.986447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ce457f4c-6a27-4c9b-af37-8399f7940209 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:06.989355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ce457f4c-6a27-4c9b-af37-8399f7940209 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:06.989859 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ce457f4c-6a27-4c9b-af37-8399f7940209 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:07.156840 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ce457f4c-6a27-4c9b-af37-8399f7940209 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 25827 microversion: 2.20 time: 0.199475 Jan 28 01:58:07.162024 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 113/221] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:06 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 25827 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:07.420528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-72340fec-ef2f-43a4-bd96-8d957f38bc14 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:07.421830 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-72340fec-ef2f-43a4-bd96-8d957f38bc14 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:07.434226 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72340fec-ef2f-43a4-bd96-8d957f38bc14 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:07.435067 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72340fec-ef2f-43a4-bd96-8d957f38bc14 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:07.436073 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72340fec-ef2f-43a4-bd96-8d957f38bc14 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:07.438852 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72340fec-ef2f-43a4-bd96-8d957f38bc14 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:07.581976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-72340fec-ef2f-43a4-bd96-8d957f38bc14 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:07.591991 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-72340fec-ef2f-43a4-bd96-8d957f38bc14 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1276 microversion: 2.1 time: 0.180578 Jan 28 01:58:07.593849 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 109/222] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:07 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:07.615945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-92f54364-fa59-45e3-8b81-e40f416f241b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:07.616659 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-92f54364-fa59-45e3-8b81-e40f416f241b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:07.625640 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92f54364-fa59-45e3-8b81-e40f416f241b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:07.626130 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92f54364-fa59-45e3-8b81-e40f416f241b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:07.628081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92f54364-fa59-45e3-8b81-e40f416f241b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:07.629628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92f54364-fa59-45e3-8b81-e40f416f241b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:07.961662 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-92f54364-fa59-45e3-8b81-e40f416f241b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:07.972684 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-92f54364-fa59-45e3-8b81-e40f416f241b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.360636 Jan 28 01:58:07.974692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 114/223] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:07 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:08.171426 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a1fc6e69-0677-4378-9dce-6d556326a445 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:08.172550 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a1fc6e69-0677-4378-9dce-6d556326a445 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:08.182497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1fc6e69-0677-4378-9dce-6d556326a445 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:08.187598 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1fc6e69-0677-4378-9dce-6d556326a445 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:08.188943 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1fc6e69-0677-4378-9dce-6d556326a445 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:08.194537 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1fc6e69-0677-4378-9dce-6d556326a445 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:08.331219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a1fc6e69-0677-4378-9dce-6d556326a445 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 26608 microversion: 2.20 time: 0.164348 Jan 28 01:58:08.339669 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 110/224] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:08 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 26608 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:08.611044 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2450a7df-68e5-431b-8503-6e1a3ef8ed0b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:08.611851 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2450a7df-68e5-431b-8503-6e1a3ef8ed0b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:08.624665 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2450a7df-68e5-431b-8503-6e1a3ef8ed0b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:08.630582 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2450a7df-68e5-431b-8503-6e1a3ef8ed0b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:08.631639 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2450a7df-68e5-431b-8503-6e1a3ef8ed0b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:08.632282 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2450a7df-68e5-431b-8503-6e1a3ef8ed0b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:08.977206 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2450a7df-68e5-431b-8503-6e1a3ef8ed0b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:08.993137 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-00a6c972-3c0a-4ce5-8fc7-15ebc1d85341 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:08.993825 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-00a6c972-3c0a-4ce5-8fc7-15ebc1d85341 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:08.999812 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2450a7df-68e5-431b-8503-6e1a3ef8ed0b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.394597 Jan 28 01:58:09.003651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 115/225] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:08 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:09.011748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-00a6c972-3c0a-4ce5-8fc7-15ebc1d85341 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:09.012268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-00a6c972-3c0a-4ce5-8fc7-15ebc1d85341 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:09.015029 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-00a6c972-3c0a-4ce5-8fc7-15ebc1d85341 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:09.016416 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-00a6c972-3c0a-4ce5-8fc7-15ebc1d85341 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:09.314199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-00a6c972-3c0a-4ce5-8fc7-15ebc1d85341 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:09.326750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-00a6c972-3c0a-4ce5-8fc7-15ebc1d85341 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.337733 Jan 28 01:58:09.339618 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 111/226] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:08 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:09.347237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8507b7af-22be-411f-a4f3-00c84eb682b3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:09.348251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8507b7af-22be-411f-a4f3-00c84eb682b3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:09.362201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8507b7af-22be-411f-a4f3-00c84eb682b3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:09.362662 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8507b7af-22be-411f-a4f3-00c84eb682b3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:09.374945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8507b7af-22be-411f-a4f3-00c84eb682b3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:09.375405 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8507b7af-22be-411f-a4f3-00c84eb682b3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:09.530535 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8507b7af-22be-411f-a4f3-00c84eb682b3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 27251 microversion: 2.20 time: 0.185629 Jan 28 01:58:09.532223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 116/227] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:09 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 27251 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:09.782054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-59595c13-57aa-41ed-99de-0800ba9ce17c req-7ee1c69b-e500-4254-afdb-73f982c1c3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d2fd8d-b37d-47af-8c84-b481723641aa", "tag": "770e2a60-f836-46bc-ba19-66a19ac3ab81"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:09.785976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:58:09.785976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:58:09.802957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-59595c13-57aa-41ed-99de-0800ba9ce17c req-7ee1c69b-e500-4254-afdb-73f982c1c3d5 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:09.803591 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-59595c13-57aa-41ed-99de-0800ba9ce17c req-7ee1c69b-e500-4254-afdb-73f982c1c3d5 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:09.834883 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-59595c13-57aa-41ed-99de-0800ba9ce17c req-7ee1c69b-e500-4254-afdb-73f982c1c3d5 service nova] Creating event network-changed:770e2a60-f836-46bc-ba19-66a19ac3ab81 for instance d4d2fd8d-b37d-47af-8c84-b481723641aa on hv-cinder-82497 Jan 28 01:58:09.855602 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-59595c13-57aa-41ed-99de-0800ba9ce17c req-7ee1c69b-e500-4254-afdb-73f982c1c3d5 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085663 Jan 28 01:58:09.858546 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 112/228] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:10.020044 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c4be191e-bd3e-4b1e-8f4f-8ed9c50f16bd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:10.021104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c4be191e-bd3e-4b1e-8f4f-8ed9c50f16bd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:10.031873 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4be191e-bd3e-4b1e-8f4f-8ed9c50f16bd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:10.033018 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4be191e-bd3e-4b1e-8f4f-8ed9c50f16bd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:10.033932 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4be191e-bd3e-4b1e-8f4f-8ed9c50f16bd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:10.034455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4be191e-bd3e-4b1e-8f4f-8ed9c50f16bd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:10.304047 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c4be191e-bd3e-4b1e-8f4f-8ed9c50f16bd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:10.313256 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c4be191e-bd3e-4b1e-8f4f-8ed9c50f16bd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.300511 Jan 28 01:58:10.314267 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 117/229] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:10 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:10.350600 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3c59f2e8-8708-4a4d-95c9-04105beb41aa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:10.352028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3c59f2e8-8708-4a4d-95c9-04105beb41aa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:10.360393 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c59f2e8-8708-4a4d-95c9-04105beb41aa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:10.361309 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c59f2e8-8708-4a4d-95c9-04105beb41aa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:10.362215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c59f2e8-8708-4a4d-95c9-04105beb41aa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:10.362776 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c59f2e8-8708-4a4d-95c9-04105beb41aa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:10.544105 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-de1f80ae-62f2-4a67-8f93-7ba8771d3337 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:10.545901 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-de1f80ae-62f2-4a67-8f93-7ba8771d3337 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:10.553540 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de1f80ae-62f2-4a67-8f93-7ba8771d3337 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:10.555698 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de1f80ae-62f2-4a67-8f93-7ba8771d3337 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:10.558031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de1f80ae-62f2-4a67-8f93-7ba8771d3337 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:10.561274 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de1f80ae-62f2-4a67-8f93-7ba8771d3337 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:10.598781 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3c59f2e8-8708-4a4d-95c9-04105beb41aa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:10.611089 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3c59f2e8-8708-4a4d-95c9-04105beb41aa tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.265288 Jan 28 01:58:10.612045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 113/230] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:10 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:10.745605 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-de1f80ae-62f2-4a67-8f93-7ba8771d3337 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 27607 microversion: 2.20 time: 0.205743 Jan 28 01:58:10.747541 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 118/231] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:10 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 27607 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:11.330989 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f113e2fb-95b7-4b89-ab7e-c8aef02e9bba tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:11.331606 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f113e2fb-95b7-4b89-ab7e-c8aef02e9bba tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:11.337703 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f113e2fb-95b7-4b89-ab7e-c8aef02e9bba tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:11.338399 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f113e2fb-95b7-4b89-ab7e-c8aef02e9bba tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:11.339342 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f113e2fb-95b7-4b89-ab7e-c8aef02e9bba tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:11.340068 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f113e2fb-95b7-4b89-ab7e-c8aef02e9bba tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:11.516768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f113e2fb-95b7-4b89-ab7e-c8aef02e9bba tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:11.525091 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f113e2fb-95b7-4b89-ab7e-c8aef02e9bba tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.197784 Jan 28 01:58:11.526742 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 114/232] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:11 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:11.628359 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-52658e98-5449-4a94-88da-033d49cce8e2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:11.629523 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-52658e98-5449-4a94-88da-033d49cce8e2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:11.637676 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52658e98-5449-4a94-88da-033d49cce8e2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:11.638126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52658e98-5449-4a94-88da-033d49cce8e2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:11.642818 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52658e98-5449-4a94-88da-033d49cce8e2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:11.643313 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52658e98-5449-4a94-88da-033d49cce8e2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:11.763227 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2546769f-901b-4ccf-9a1b-de90a9bd95ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:11.764702 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2546769f-901b-4ccf-9a1b-de90a9bd95ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:11.770647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2546769f-901b-4ccf-9a1b-de90a9bd95ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:11.771492 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2546769f-901b-4ccf-9a1b-de90a9bd95ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:11.772548 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2546769f-901b-4ccf-9a1b-de90a9bd95ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:11.773131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2546769f-901b-4ccf-9a1b-de90a9bd95ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:11.815328 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-52658e98-5449-4a94-88da-033d49cce8e2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:11.823603 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-52658e98-5449-4a94-88da-033d49cce8e2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.199384 Jan 28 01:58:11.825377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 119/233] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:11 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:11.914080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2546769f-901b-4ccf-9a1b-de90a9bd95ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 27784 microversion: 2.20 time: 0.153629 Jan 28 01:58:11.915036 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 115/234] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:11 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 27784 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:12.544641 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dcdd08cd-8aee-464c-8e25-9d1a8bcf362f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:12.553501 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dcdd08cd-8aee-464c-8e25-9d1a8bcf362f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:12.560508 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dcdd08cd-8aee-464c-8e25-9d1a8bcf362f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:12.561484 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dcdd08cd-8aee-464c-8e25-9d1a8bcf362f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:12.562314 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dcdd08cd-8aee-464c-8e25-9d1a8bcf362f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:12.562792 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dcdd08cd-8aee-464c-8e25-9d1a8bcf362f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:12.707548 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dcdd08cd-8aee-464c-8e25-9d1a8bcf362f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:12.714958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dcdd08cd-8aee-464c-8e25-9d1a8bcf362f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.175192 Jan 28 01:58:12.715530 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 120/235] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:12 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:12.843929 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4f9b414c-011d-4468-bfdf-c775f30ed503 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:12.845239 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4f9b414c-011d-4468-bfdf-c775f30ed503 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:12.852765 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f9b414c-011d-4468-bfdf-c775f30ed503 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:12.853276 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f9b414c-011d-4468-bfdf-c775f30ed503 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:12.856995 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f9b414c-011d-4468-bfdf-c775f30ed503 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:12.858122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f9b414c-011d-4468-bfdf-c775f30ed503 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:12.926331 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-97927134-9752-47a7-887f-45010cfbed42 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:12.927618 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-97927134-9752-47a7-887f-45010cfbed42 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:12.938991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-97927134-9752-47a7-887f-45010cfbed42 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:12.939759 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-97927134-9752-47a7-887f-45010cfbed42 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:12.940638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-97927134-9752-47a7-887f-45010cfbed42 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:12.941172 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-97927134-9752-47a7-887f-45010cfbed42 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:13.033556 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4f9b414c-011d-4468-bfdf-c775f30ed503 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:13.041177 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4f9b414c-011d-4468-bfdf-c775f30ed503 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.202580 Jan 28 01:58:13.041759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 116/236] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:12 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:13.065337 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-97927134-9752-47a7-887f-45010cfbed42 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28006 microversion: 2.20 time: 0.142973 Jan 28 01:58:13.066139 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 121/237] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:12 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28006 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:13.733902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc57f248-d6f6-46dd-8b11-c86b50d1b390 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:13.734798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc57f248-d6f6-46dd-8b11-c86b50d1b390 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:13.742116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc57f248-d6f6-46dd-8b11-c86b50d1b390 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:13.742652 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc57f248-d6f6-46dd-8b11-c86b50d1b390 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:13.743594 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc57f248-d6f6-46dd-8b11-c86b50d1b390 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:13.744075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc57f248-d6f6-46dd-8b11-c86b50d1b390 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:13.951947 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bc57f248-d6f6-46dd-8b11-c86b50d1b390 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:13.961456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc57f248-d6f6-46dd-8b11-c86b50d1b390 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.230427 Jan 28 01:58:13.961456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 117/238] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:13 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:14.059485 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f8e083e8-40f5-43cd-928f-b7414a934315 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:14.061223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f8e083e8-40f5-43cd-928f-b7414a934315 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:14.069537 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f8e083e8-40f5-43cd-928f-b7414a934315 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:14.069980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f8e083e8-40f5-43cd-928f-b7414a934315 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:14.070916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f8e083e8-40f5-43cd-928f-b7414a934315 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:14.071446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f8e083e8-40f5-43cd-928f-b7414a934315 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:14.084122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e87b2dc1-f520-441b-a952-38e095e02163 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:14.086151 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e87b2dc1-f520-441b-a952-38e095e02163 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:14.094697 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e87b2dc1-f520-441b-a952-38e095e02163 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:14.095372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e87b2dc1-f520-441b-a952-38e095e02163 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:14.096578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e87b2dc1-f520-441b-a952-38e095e02163 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:14.097152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e87b2dc1-f520-441b-a952-38e095e02163 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:14.238434 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e87b2dc1-f520-441b-a952-38e095e02163 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28148 microversion: 2.20 time: 0.163700 Jan 28 01:58:14.239521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 118/239] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:14 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28148 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:14.270130 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f8e083e8-40f5-43cd-928f-b7414a934315 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:14.289822 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f8e083e8-40f5-43cd-928f-b7414a934315 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.234462 Jan 28 01:58:14.290403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 122/240] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:14 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:14.979515 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4b93aaa5-f1e3-470e-8b6d-f4366570f1df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:14.981281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4b93aaa5-f1e3-470e-8b6d-f4366570f1df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:14.989146 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4b93aaa5-f1e3-470e-8b6d-f4366570f1df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:14.989520 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4b93aaa5-f1e3-470e-8b6d-f4366570f1df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:14.990536 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4b93aaa5-f1e3-470e-8b6d-f4366570f1df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:14.990970 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4b93aaa5-f1e3-470e-8b6d-f4366570f1df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:15.136150 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4b93aaa5-f1e3-470e-8b6d-f4366570f1df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:15.145966 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4b93aaa5-f1e3-470e-8b6d-f4366570f1df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.170983 Jan 28 01:58:15.146544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 119/241] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:14 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:15.250906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2fae88e0-7b98-451f-bd98-500b2ae97a51 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:15.252482 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2fae88e0-7b98-451f-bd98-500b2ae97a51 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:15.259508 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fae88e0-7b98-451f-bd98-500b2ae97a51 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:15.259944 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fae88e0-7b98-451f-bd98-500b2ae97a51 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:15.260894 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fae88e0-7b98-451f-bd98-500b2ae97a51 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:15.261541 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fae88e0-7b98-451f-bd98-500b2ae97a51 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:15.307515 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-682595e7-2f27-40a0-bd6a-9a5ee1ddff99 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:15.308120 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-682595e7-2f27-40a0-bd6a-9a5ee1ddff99 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:15.314564 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-682595e7-2f27-40a0-bd6a-9a5ee1ddff99 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:15.315263 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-682595e7-2f27-40a0-bd6a-9a5ee1ddff99 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:15.316035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-682595e7-2f27-40a0-bd6a-9a5ee1ddff99 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:15.316463 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-682595e7-2f27-40a0-bd6a-9a5ee1ddff99 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:15.458043 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-682595e7-2f27-40a0-bd6a-9a5ee1ddff99 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:15.467891 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-682595e7-2f27-40a0-bd6a-9a5ee1ddff99 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.163098 Jan 28 01:58:15.470534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 120/242] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:15 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:16.163664 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-002d5e44-cfc5-4f86-8463-ea50943a92c7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:16.164272 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-002d5e44-cfc5-4f86-8463-ea50943a92c7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:16.170880 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-002d5e44-cfc5-4f86-8463-ea50943a92c7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:16.171323 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-002d5e44-cfc5-4f86-8463-ea50943a92c7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:16.172082 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-002d5e44-cfc5-4f86-8463-ea50943a92c7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:16.172513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-002d5e44-cfc5-4f86-8463-ea50943a92c7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:16.297902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-002d5e44-cfc5-4f86-8463-ea50943a92c7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:16.305546 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-002d5e44-cfc5-4f86-8463-ea50943a92c7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.145703 Jan 28 01:58:16.306107 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 121/243] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:16 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:16.492152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8bf135ae-e97a-4c04-930f-4301de6bb6e4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:16.492751 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8bf135ae-e97a-4c04-930f-4301de6bb6e4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:16.499346 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8bf135ae-e97a-4c04-930f-4301de6bb6e4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:16.499786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8bf135ae-e97a-4c04-930f-4301de6bb6e4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:16.500554 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8bf135ae-e97a-4c04-930f-4301de6bb6e4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:16.501021 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8bf135ae-e97a-4c04-930f-4301de6bb6e4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:16.625463 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8bf135ae-e97a-4c04-930f-4301de6bb6e4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:16.632841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8bf135ae-e97a-4c04-930f-4301de6bb6e4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.144379 Jan 28 01:58:16.633412 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 122/244] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:16 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:17.322700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ef2fff62-c84c-435e-b94b-9ffd0be42b7a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:17.323321 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ef2fff62-c84c-435e-b94b-9ffd0be42b7a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:17.330203 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef2fff62-c84c-435e-b94b-9ffd0be42b7a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:17.330650 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef2fff62-c84c-435e-b94b-9ffd0be42b7a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:17.331419 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef2fff62-c84c-435e-b94b-9ffd0be42b7a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:17.331851 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef2fff62-c84c-435e-b94b-9ffd0be42b7a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:17.454319 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ef2fff62-c84c-435e-b94b-9ffd0be42b7a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:17.461603 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ef2fff62-c84c-435e-b94b-9ffd0be42b7a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.142542 Jan 28 01:58:17.462336 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 123/245] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:17 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:17.651563 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ccfdaf1f-91cb-43d7-a08d-e4bc062a3611 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:17.652184 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ccfdaf1f-91cb-43d7-a08d-e4bc062a3611 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:17.658829 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ccfdaf1f-91cb-43d7-a08d-e4bc062a3611 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:17.659282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ccfdaf1f-91cb-43d7-a08d-e4bc062a3611 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:17.660070 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ccfdaf1f-91cb-43d7-a08d-e4bc062a3611 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:17.660508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ccfdaf1f-91cb-43d7-a08d-e4bc062a3611 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:17.765103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2fae88e0-7b98-451f-bd98-500b2ae97a51 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28148 microversion: 2.20 time: 2.518055 Jan 28 01:58:17.766397 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 123/246] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:15 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28148 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:17.800098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ccfdaf1f-91cb-43d7-a08d-e4bc062a3611 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:17.807541 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ccfdaf1f-91cb-43d7-a08d-e4bc062a3611 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.159894 Jan 28 01:58:17.808045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 124/247] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:17 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:18.479697 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9c57a648-2ee1-4a36-9c21-52350842f87d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:18.480702 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9c57a648-2ee1-4a36-9c21-52350842f87d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:18.488814 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9c57a648-2ee1-4a36-9c21-52350842f87d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:18.489185 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9c57a648-2ee1-4a36-9c21-52350842f87d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:18.490250 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9c57a648-2ee1-4a36-9c21-52350842f87d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:18.490806 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9c57a648-2ee1-4a36-9c21-52350842f87d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:18.627195 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9c57a648-2ee1-4a36-9c21-52350842f87d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:18.634404 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9c57a648-2ee1-4a36-9c21-52350842f87d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.159028 Jan 28 01:58:18.634968 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 124/248] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:18 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:18.778261 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-975a78ef-8922-4387-b9f0-66413d1debbf tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:18.781645 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-975a78ef-8922-4387-b9f0-66413d1debbf tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:18.788747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-975a78ef-8922-4387-b9f0-66413d1debbf tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:18.789560 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-975a78ef-8922-4387-b9f0-66413d1debbf tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:18.790987 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-975a78ef-8922-4387-b9f0-66413d1debbf tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:18.791689 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-975a78ef-8922-4387-b9f0-66413d1debbf tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:18.826443 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-db5778ce-5e84-4bfa-9ee6-835f38e60ef5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:18.827232 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-db5778ce-5e84-4bfa-9ee6-835f38e60ef5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:18.834343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db5778ce-5e84-4bfa-9ee6-835f38e60ef5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:18.834853 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db5778ce-5e84-4bfa-9ee6-835f38e60ef5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:18.835637 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db5778ce-5e84-4bfa-9ee6-835f38e60ef5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:18.836487 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db5778ce-5e84-4bfa-9ee6-835f38e60ef5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:19.009876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-db5778ce-5e84-4bfa-9ee6-835f38e60ef5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:19.017734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-db5778ce-5e84-4bfa-9ee6-835f38e60ef5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.196408 Jan 28 01:58:19.018490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 125/249] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:18 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:19.651755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b32a1f36-e793-4ee1-a74e-2f6545122d16 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:19.652395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b32a1f36-e793-4ee1-a74e-2f6545122d16 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:19.661476 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b32a1f36-e793-4ee1-a74e-2f6545122d16 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:19.661948 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b32a1f36-e793-4ee1-a74e-2f6545122d16 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:19.662721 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b32a1f36-e793-4ee1-a74e-2f6545122d16 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:19.663149 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b32a1f36-e793-4ee1-a74e-2f6545122d16 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:19.801828 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b32a1f36-e793-4ee1-a74e-2f6545122d16 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:19.811110 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b32a1f36-e793-4ee1-a74e-2f6545122d16 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.163414 Jan 28 01:58:19.811923 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 126/250] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:19 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:20.035540 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d2fa6327-a411-481f-b39f-650f7c12a007 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:20.036223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d2fa6327-a411-481f-b39f-650f7c12a007 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:20.042148 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2fa6327-a411-481f-b39f-650f7c12a007 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:20.042660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2fa6327-a411-481f-b39f-650f7c12a007 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:20.043433 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2fa6327-a411-481f-b39f-650f7c12a007 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:20.043864 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2fa6327-a411-481f-b39f-650f7c12a007 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:20.189155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d2fa6327-a411-481f-b39f-650f7c12a007 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:20.197839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d2fa6327-a411-481f-b39f-650f7c12a007 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.165854 Jan 28 01:58:20.198717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 127/251] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:20 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:20.829816 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fad6a275-c60e-479f-a35f-befc46fdcfdf tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:20.831010 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fad6a275-c60e-479f-a35f-befc46fdcfdf tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:20.839389 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fad6a275-c60e-479f-a35f-befc46fdcfdf tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:20.840140 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fad6a275-c60e-479f-a35f-befc46fdcfdf tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:20.842431 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fad6a275-c60e-479f-a35f-befc46fdcfdf tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:20.843435 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fad6a275-c60e-479f-a35f-befc46fdcfdf tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:21.069881 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fad6a275-c60e-479f-a35f-befc46fdcfdf tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:21.081841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fad6a275-c60e-479f-a35f-befc46fdcfdf tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.257764 Jan 28 01:58:21.083215 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 128/252] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:20 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:21.091119 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-ae9e517e-ae71-4371-8cb7-48dfa19a67a1 req-3043f39b-bfc8-46be-bb7d-767a573e75d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d2fd8d-b37d-47af-8c84-b481723641aa", "name": "network-vif-plugged", "status": "completed", "tag": "770e2a60-f836-46bc-ba19-66a19ac3ab81"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:21.093927 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:58:21.093927 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 01:58:21.106901 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ae9e517e-ae71-4371-8cb7-48dfa19a67a1 req-3043f39b-bfc8-46be-bb7d-767a573e75d8 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:21.107885 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ae9e517e-ae71-4371-8cb7-48dfa19a67a1 req-3043f39b-bfc8-46be-bb7d-767a573e75d8 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:21.121481 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-ae9e517e-ae71-4371-8cb7-48dfa19a67a1 req-3043f39b-bfc8-46be-bb7d-767a573e75d8 service nova] Creating event network-vif-plugged:770e2a60-f836-46bc-ba19-66a19ac3ab81 for instance d4d2fd8d-b37d-47af-8c84-b481723641aa on hv-cinder-82497 Jan 28 01:58:21.136556 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-ae9e517e-ae71-4371-8cb7-48dfa19a67a1 req-3043f39b-bfc8-46be-bb7d-767a573e75d8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051661 Jan 28 01:58:21.137257 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 129/253] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:21.219686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cbdfd891-3e2d-4753-aaf6-bce44ae6c738 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:21.220705 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cbdfd891-3e2d-4753-aaf6-bce44ae6c738 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:21.227559 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cbdfd891-3e2d-4753-aaf6-bce44ae6c738 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:21.228013 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cbdfd891-3e2d-4753-aaf6-bce44ae6c738 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:21.229652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cbdfd891-3e2d-4753-aaf6-bce44ae6c738 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:21.229652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cbdfd891-3e2d-4753-aaf6-bce44ae6c738 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:21.380326 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cbdfd891-3e2d-4753-aaf6-bce44ae6c738 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:21.386933 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cbdfd891-3e2d-4753-aaf6-bce44ae6c738 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.174704 Jan 28 01:58:21.387596 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 130/254] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:21 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:21.715731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-975a78ef-8922-4387-b9f0-66413d1debbf tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28148 microversion: 2.20 time: 2.942103 Jan 28 01:58:21.717075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 125/255] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:18 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28148 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:22.108032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2ff789b6-6415-48ae-bc56-214f700712dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:22.108032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2ff789b6-6415-48ae-bc56-214f700712dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:22.114934 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ff789b6-6415-48ae-bc56-214f700712dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:22.115372 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ff789b6-6415-48ae-bc56-214f700712dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:22.116159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ff789b6-6415-48ae-bc56-214f700712dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:22.116583 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ff789b6-6415-48ae-bc56-214f700712dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:22.383825 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2ff789b6-6415-48ae-bc56-214f700712dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:22.391997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2ff789b6-6415-48ae-bc56-214f700712dc tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.288742 Jan 28 01:58:22.392612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 131/256] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:22 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:22.410528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-20a7b376-156d-4697-b066-a6aaadb90d85 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:22.411291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-20a7b376-156d-4697-b066-a6aaadb90d85 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:22.418549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20a7b376-156d-4697-b066-a6aaadb90d85 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:22.418969 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20a7b376-156d-4697-b066-a6aaadb90d85 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:22.420416 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20a7b376-156d-4697-b066-a6aaadb90d85 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:22.420896 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20a7b376-156d-4697-b066-a6aaadb90d85 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:22.589284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-20a7b376-156d-4697-b066-a6aaadb90d85 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:22.610590 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-20a7b376-156d-4697-b066-a6aaadb90d85 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.204328 Jan 28 01:58:22.619867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 126/257] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:22 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:22.728680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c8381584-3b03-4a47-854b-232ac2355444 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:22.729920 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c8381584-3b03-4a47-854b-232ac2355444 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:22.737376 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8381584-3b03-4a47-854b-232ac2355444 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:22.737759 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8381584-3b03-4a47-854b-232ac2355444 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:22.738670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8381584-3b03-4a47-854b-232ac2355444 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:22.739323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8381584-3b03-4a47-854b-232ac2355444 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:22.870885 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c8381584-3b03-4a47-854b-232ac2355444 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28148 microversion: 2.20 time: 0.146005 Jan 28 01:58:22.875615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 132/258] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:22 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28148 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:23.414635 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b8b28ea5-b3a3-4a90-a57b-60d9ba505bd5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:23.415760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b8b28ea5-b3a3-4a90-a57b-60d9ba505bd5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:23.426350 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8b28ea5-b3a3-4a90-a57b-60d9ba505bd5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:23.427095 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8b28ea5-b3a3-4a90-a57b-60d9ba505bd5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:23.428363 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8b28ea5-b3a3-4a90-a57b-60d9ba505bd5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:23.429120 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8b28ea5-b3a3-4a90-a57b-60d9ba505bd5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:23.637716 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5d2d2aca-eac1-4ecb-9d09-c65cbeeef5ac tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:23.643445 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5d2d2aca-eac1-4ecb-9d09-c65cbeeef5ac tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:23.657401 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d2d2aca-eac1-4ecb-9d09-c65cbeeef5ac tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:23.657964 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d2d2aca-eac1-4ecb-9d09-c65cbeeef5ac tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:23.658820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d2d2aca-eac1-4ecb-9d09-c65cbeeef5ac tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:23.659341 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d2d2aca-eac1-4ecb-9d09-c65cbeeef5ac tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:23.708845 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b8b28ea5-b3a3-4a90-a57b-60d9ba505bd5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:23.719569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b8b28ea5-b3a3-4a90-a57b-60d9ba505bd5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1318 microversion: 2.1 time: 0.311414 Jan 28 01:58:23.720463 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 127/259] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:23 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:23.883393 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a5417228-3e87-4718-b086-a1cb7701b49d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:23.884331 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a5417228-3e87-4718-b086-a1cb7701b49d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:23.892657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a5417228-3e87-4718-b086-a1cb7701b49d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:23.893506 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a5417228-3e87-4718-b086-a1cb7701b49d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:23.894649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a5417228-3e87-4718-b086-a1cb7701b49d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:23.895236 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a5417228-3e87-4718-b086-a1cb7701b49d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:23.917601 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5d2d2aca-eac1-4ecb-9d09-c65cbeeef5ac tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:23.929855 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5d2d2aca-eac1-4ecb-9d09-c65cbeeef5ac tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.303198 Jan 28 01:58:23.941314 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 133/260] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:23 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:24.062910 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a5417228-3e87-4718-b086-a1cb7701b49d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28173 microversion: 2.20 time: 0.182739 Jan 28 01:58:24.067392 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 128/261] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:23 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28173 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:24.752441 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3f3686af-4988-40ea-a62a-98c649f18170 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:24.754189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3f3686af-4988-40ea-a62a-98c649f18170 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:24.767201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f3686af-4988-40ea-a62a-98c649f18170 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:24.769110 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f3686af-4988-40ea-a62a-98c649f18170 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:24.770538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f3686af-4988-40ea-a62a-98c649f18170 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:24.771493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f3686af-4988-40ea-a62a-98c649f18170 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:24.957185 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-97698baa-9011-47e6-ac5f-5848953e2622 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:24.958676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-97698baa-9011-47e6-ac5f-5848953e2622 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:24.970269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97698baa-9011-47e6-ac5f-5848953e2622 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:24.971376 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97698baa-9011-47e6-ac5f-5848953e2622 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:24.972972 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97698baa-9011-47e6-ac5f-5848953e2622 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:24.973921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97698baa-9011-47e6-ac5f-5848953e2622 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:25.338826 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3f3686af-4988-40ea-a62a-98c649f18170 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:25.371906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3f3686af-4988-40ea-a62a-98c649f18170 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1509 microversion: 2.1 time: 0.626955 Jan 28 01:58:25.371906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 134/262] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:24 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1509 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:25.399145 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d4696143-7efa-439e-9054-b0e08cc73a8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:25.400840 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d4696143-7efa-439e-9054-b0e08cc73a8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:25.410954 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4696143-7efa-439e-9054-b0e08cc73a8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:25.411912 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4696143-7efa-439e-9054-b0e08cc73a8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:25.413253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4696143-7efa-439e-9054-b0e08cc73a8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:25.414823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4696143-7efa-439e-9054-b0e08cc73a8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:25.530316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-97698baa-9011-47e6-ac5f-5848953e2622 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:25.547163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-97698baa-9011-47e6-ac5f-5848953e2622 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.602015 Jan 28 01:58:25.548954 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 129/263] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:24 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:25.564760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "832f208b-b47d-4674-9891-2a0836ae10f3"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:25.568173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:25.577949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:25.578788 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:25.580251 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:25.581135 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:25.583275 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d4696143-7efa-439e-9054-b0e08cc73a8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28427 microversion: 2.20 time: 0.209077 Jan 28 01:58:25.592364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 135/264] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:25 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:25.746172 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] HTTP exception thrown: Invalid volume: volume 832f208b-b47d-4674-9891-2a0836ae10f3 is already attached to instances: 6e5194c2-f570-4463-8a44-765cf06f1206 Jan 28 01:58:25.748181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Returning 400 to user: Invalid volume: volume 832f208b-b47d-4674-9891-2a0836ae10f3 is already attached to instances: 6e5194c2-f570-4463-8a44-765cf06f1206 {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:58:25.750139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-45d02947-562d-46ca-9e9f-cdced5e8594d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.198913 Jan 28 01:58:25.751216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 130/265] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 01:58:25 2022] POST /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa/os-volume_attachments => generated 174 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:58:25.862530 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cab30bbc-83b0-4f75-bc43-3d9a0c56fb93 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:25.863587 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cab30bbc-83b0-4f75-bc43-3d9a0c56fb93 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:25.878622 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cab30bbc-83b0-4f75-bc43-3d9a0c56fb93 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:25.880695 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cab30bbc-83b0-4f75-bc43-3d9a0c56fb93 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:25.883987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cab30bbc-83b0-4f75-bc43-3d9a0c56fb93 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:25.886137 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cab30bbc-83b0-4f75-bc43-3d9a0c56fb93 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:26.047407 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-cab30bbc-83b0-4f75-bc43-3d9a0c56fb93 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lazy-loading 'services' on Instance uuid 6e5194c2-f570-4463-8a44-765cf06f1206 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:58:26.165760 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cab30bbc-83b0-4f75-bc43-3d9a0c56fb93 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "DELETE /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments/832f208b-b47d-4674-9891-2a0836ae10f3" status: 202 len: 0 microversion: 2.1 time: 0.307557 Jan 28 01:58:26.166798 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 136/266] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 01:58:25 2022] DELETE /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments/832f208b-b47d-4674-9891-2a0836ae10f3 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:26.176203 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8ec92998-ade0-4c80-af29-6991cd951f1c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:26.177388 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8ec92998-ade0-4c80-af29-6991cd951f1c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:26.185124 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ec92998-ade0-4c80-af29-6991cd951f1c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:26.186308 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ec92998-ade0-4c80-af29-6991cd951f1c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:26.187142 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ec92998-ade0-4c80-af29-6991cd951f1c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:26.187816 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ec92998-ade0-4c80-af29-6991cd951f1c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:26.226427 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8ec92998-ade0-4c80-af29-6991cd951f1c tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054092 Jan 28 01:58:26.226994 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 131/267] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:58:26 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:26.574686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-96106a06-5eb3-4396-9605-9e5c090957f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:26.575908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-96106a06-5eb3-4396-9605-9e5c090957f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:26.587440 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96106a06-5eb3-4396-9605-9e5c090957f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:26.588415 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96106a06-5eb3-4396-9605-9e5c090957f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:26.590062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96106a06-5eb3-4396-9605-9e5c090957f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:26.590837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96106a06-5eb3-4396-9605-9e5c090957f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:26.604926 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3021425b-55a4-4fba-91dd-df05125c4ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:26.606444 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3021425b-55a4-4fba-91dd-df05125c4ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:26.624721 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3021425b-55a4-4fba-91dd-df05125c4ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:26.625498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3021425b-55a4-4fba-91dd-df05125c4ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:26.626789 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3021425b-55a4-4fba-91dd-df05125c4ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:26.629667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3021425b-55a4-4fba-91dd-df05125c4ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:26.805955 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3021425b-55a4-4fba-91dd-df05125c4ec8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28594 microversion: 2.20 time: 0.208593 Jan 28 01:58:26.807117 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 132/268] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:26 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28594 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:26.846558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-96106a06-5eb3-4396-9605-9e5c090957f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:26.860388 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-96106a06-5eb3-4396-9605-9e5c090957f5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.289641 Jan 28 01:58:26.861301 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 137/269] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:26 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:27.243824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-26fff690-2981-4be7-bdd7-bd330cfe70e9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:27.245778 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-26fff690-2981-4be7-bdd7-bd330cfe70e9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:27.256646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-26fff690-2981-4be7-bdd7-bd330cfe70e9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:27.257726 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-26fff690-2981-4be7-bdd7-bd330cfe70e9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:27.259370 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-26fff690-2981-4be7-bdd7-bd330cfe70e9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:27.260158 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-26fff690-2981-4be7-bdd7-bd330cfe70e9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:27.303909 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-26fff690-2981-4be7-bdd7-bd330cfe70e9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068054 Jan 28 01:58:27.308234 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 133/270] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:58:27 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:27.822141 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d8e91fd7-9fbc-4ae7-a2a3-d0729074bc96 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:27.823029 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d8e91fd7-9fbc-4ae7-a2a3-d0729074bc96 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:27.830175 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d8e91fd7-9fbc-4ae7-a2a3-d0729074bc96 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:27.830627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d8e91fd7-9fbc-4ae7-a2a3-d0729074bc96 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:27.831407 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d8e91fd7-9fbc-4ae7-a2a3-d0729074bc96 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:27.831839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d8e91fd7-9fbc-4ae7-a2a3-d0729074bc96 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:27.881936 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b28f66b2-780e-45d4-b29d-baca98c74e61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:27.882567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b28f66b2-780e-45d4-b29d-baca98c74e61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:27.888509 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b28f66b2-780e-45d4-b29d-baca98c74e61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:27.888966 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b28f66b2-780e-45d4-b29d-baca98c74e61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:27.889751 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b28f66b2-780e-45d4-b29d-baca98c74e61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:27.890183 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b28f66b2-780e-45d4-b29d-baca98c74e61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:28.023835 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b28f66b2-780e-45d4-b29d-baca98c74e61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:28.032384 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b28f66b2-780e-45d4-b29d-baca98c74e61 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.154520 Jan 28 01:58:28.033043 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 134/271] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:27 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:28.319577 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-66141a36-292c-44ac-a7b3-c73da8a24622 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:28.320673 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-66141a36-292c-44ac-a7b3-c73da8a24622 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:28.328194 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66141a36-292c-44ac-a7b3-c73da8a24622 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:28.328685 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66141a36-292c-44ac-a7b3-c73da8a24622 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:28.329568 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66141a36-292c-44ac-a7b3-c73da8a24622 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:28.330039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66141a36-292c-44ac-a7b3-c73da8a24622 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:28.362282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-66141a36-292c-44ac-a7b3-c73da8a24622 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048338 Jan 28 01:58:28.362908 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 135/272] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:58:28 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:58:29.050139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-69ffd34a-00f3-4a02-a0b6-6f0fdf79575f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:29.050748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-69ffd34a-00f3-4a02-a0b6-6f0fdf79575f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:29.056688 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69ffd34a-00f3-4a02-a0b6-6f0fdf79575f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:29.057193 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69ffd34a-00f3-4a02-a0b6-6f0fdf79575f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:29.057978 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69ffd34a-00f3-4a02-a0b6-6f0fdf79575f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:29.058413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69ffd34a-00f3-4a02-a0b6-6f0fdf79575f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:29.213355 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-69ffd34a-00f3-4a02-a0b6-6f0fdf79575f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:29.227450 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-69ffd34a-00f3-4a02-a0b6-6f0fdf79575f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.180673 Jan 28 01:58:29.228487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 136/273] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:29 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:29.374917 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a8397702-22a4-4446-85d1-0bfbbeb7a63e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:29.375848 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a8397702-22a4-4446-85d1-0bfbbeb7a63e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:29.382180 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a8397702-22a4-4446-85d1-0bfbbeb7a63e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:29.382667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a8397702-22a4-4446-85d1-0bfbbeb7a63e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:29.383778 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a8397702-22a4-4446-85d1-0bfbbeb7a63e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:29.384226 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a8397702-22a4-4446-85d1-0bfbbeb7a63e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:29.420093 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a8397702-22a4-4446-85d1-0bfbbeb7a63e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049692 Jan 28 01:58:29.420680 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 137/274] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:58:29 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:58:30.257826 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-71fe8dfb-19b7-4200-be14-0841538dfa47 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:30.258866 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-71fe8dfb-19b7-4200-be14-0841538dfa47 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:30.269150 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-71fe8dfb-19b7-4200-be14-0841538dfa47 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:30.269902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-71fe8dfb-19b7-4200-be14-0841538dfa47 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:30.271549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-71fe8dfb-19b7-4200-be14-0841538dfa47 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:30.272281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-71fe8dfb-19b7-4200-be14-0841538dfa47 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:30.331801 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d8e91fd7-9fbc-4ae7-a2a3-d0729074bc96 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28594 microversion: 2.20 time: 2.513535 Jan 28 01:58:30.333444 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 138/275] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:27 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28594 bytes in 2516 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:30.420902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-71fe8dfb-19b7-4200-be14-0841538dfa47 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:30.434349 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-71fe8dfb-19b7-4200-be14-0841538dfa47 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.181961 Jan 28 01:58:30.434630 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f0bc4b82-9203-4377-8ac0-075bff58c579 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:30.435896 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 138/276] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:30 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:30.436535 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f0bc4b82-9203-4377-8ac0-075bff58c579 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:30.444948 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f0bc4b82-9203-4377-8ac0-075bff58c579 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:30.445529 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f0bc4b82-9203-4377-8ac0-075bff58c579 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:30.446432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f0bc4b82-9203-4377-8ac0-075bff58c579 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:30.446987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f0bc4b82-9203-4377-8ac0-075bff58c579 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:30.506618 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f0bc4b82-9203-4377-8ac0-075bff58c579 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077512 Jan 28 01:58:30.507653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 139/277] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:58:30 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:58:31.350587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dd732d2c-c288-45a0-a242-722aaed30476 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:31.352850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dd732d2c-c288-45a0-a242-722aaed30476 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:31.380988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd732d2c-c288-45a0-a242-722aaed30476 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:31.381833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd732d2c-c288-45a0-a242-722aaed30476 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:31.383192 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd732d2c-c288-45a0-a242-722aaed30476 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:31.384270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd732d2c-c288-45a0-a242-722aaed30476 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:31.456719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7edb156b-ba0d-4f46-b2d1-1f24f6ca6c51 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:31.457647 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7edb156b-ba0d-4f46-b2d1-1f24f6ca6c51 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:31.465327 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7edb156b-ba0d-4f46-b2d1-1f24f6ca6c51 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:31.466091 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7edb156b-ba0d-4f46-b2d1-1f24f6ca6c51 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:31.467797 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7edb156b-ba0d-4f46-b2d1-1f24f6ca6c51 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:31.468576 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7edb156b-ba0d-4f46-b2d1-1f24f6ca6c51 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:31.564840 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dd732d2c-c288-45a0-a242-722aaed30476 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28594 microversion: 2.20 time: 0.222654 Jan 28 01:58:31.566384 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 139/278] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:31 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28594 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:31.579420 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f6614ca9-2729-4304-8bdf-0b83b5c93da7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:31.581311 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f6614ca9-2729-4304-8bdf-0b83b5c93da7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:31.590761 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6614ca9-2729-4304-8bdf-0b83b5c93da7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:31.593263 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6614ca9-2729-4304-8bdf-0b83b5c93da7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:31.594595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6614ca9-2729-4304-8bdf-0b83b5c93da7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:31.595251 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6614ca9-2729-4304-8bdf-0b83b5c93da7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:31.649958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f6614ca9-2729-4304-8bdf-0b83b5c93da7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081470 Jan 28 01:58:31.650632 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 140/279] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:58:31 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:58:31.677208 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7edb156b-ba0d-4f46-b2d1-1f24f6ca6c51 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:31.690967 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7edb156b-ba0d-4f46-b2d1-1f24f6ca6c51 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.240920 Jan 28 01:58:31.692190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 140/280] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:31 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:31.905775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1024837342", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "72255c1f-77c9-4e8a-9e7a-3b079454c5f0"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:31.978327 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] validate_networks() for [('72255c1f-77c9-4e8a-9e7a-3b079454c5f0', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:58:32.581177 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d2dcf681-23ae-41ec-8512-feb6cfcdc079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:32.583075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d2dcf681-23ae-41ec-8512-feb6cfcdc079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:32.600056 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2dcf681-23ae-41ec-8512-feb6cfcdc079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:32.600503 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2dcf681-23ae-41ec-8512-feb6cfcdc079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:32.601338 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2dcf681-23ae-41ec-8512-feb6cfcdc079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:32.601773 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2dcf681-23ae-41ec-8512-feb6cfcdc079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:32.655054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:58:32.655622 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:58:32.655923 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:58:32.656325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:58:32.656731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:58:32.667356 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:32.667798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:32.668598 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:32.669068 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:32.691959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Getting quotas for project f2f478fd06754a38b139c8415da6a514. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:58:32.697796 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Getting quotas for user 1f57e62502564821b4be822554d9f5a7 and project f2f478fd06754a38b139c8415da6a514. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:58:32.714538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:58:32.718424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:58:32.769755 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6ebb573c-62fc-47db-884d-100fa172bf27 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868574 Jan 28 01:58:32.770416 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 141/281] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 01:58:32.777381 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cd53f7f7-29d3-4d8e-b2b4-dbf8a4e88f06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:32.778325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cd53f7f7-29d3-4d8e-b2b4-dbf8a4e88f06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:32.787970 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd53f7f7-29d3-4d8e-b2b4-dbf8a4e88f06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:32.788687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd53f7f7-29d3-4d8e-b2b4-dbf8a4e88f06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:32.790174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd53f7f7-29d3-4d8e-b2b4-dbf8a4e88f06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:32.790943 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd53f7f7-29d3-4d8e-b2b4-dbf8a4e88f06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:32.976397 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d2dcf681-23ae-41ec-8512-feb6cfcdc079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28594 microversion: 2.20 time: 0.400367 Jan 28 01:58:32.982443 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 141/282] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:32 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28594 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:32.992750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dbf7b92f-0c26-4196-b727-0a9890907448 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:32.994007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dbf7b92f-0c26-4196-b727-0a9890907448 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:33.064625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cd53f7f7-29d3-4d8e-b2b4-dbf8a4e88f06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:33.079707 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cd53f7f7-29d3-4d8e-b2b4-dbf8a4e88f06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.307168 Jan 28 01:58:33.080885 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 142/283] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:32 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:33.169329 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dbf7b92f-0c26-4196-b727-0a9890907448 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:33.178170 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dbf7b92f-0c26-4196-b727-0a9890907448 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1218 microversion: 2.1 time: 0.193992 Jan 28 01:58:33.180471 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 142/284] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:32 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:33.994070 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7ec149e6-d470-4256-898c-bc7775539afe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:33.996072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7ec149e6-d470-4256-898c-bc7775539afe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:34.003209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ec149e6-d470-4256-898c-bc7775539afe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:34.003966 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ec149e6-d470-4256-898c-bc7775539afe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:34.005115 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ec149e6-d470-4256-898c-bc7775539afe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:34.005790 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ec149e6-d470-4256-898c-bc7775539afe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:34.099119 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3a9d89fe-5596-4ddd-89eb-8ca7dc46a56d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:34.099912 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3a9d89fe-5596-4ddd-89eb-8ca7dc46a56d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:34.106464 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a9d89fe-5596-4ddd-89eb-8ca7dc46a56d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:34.107483 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a9d89fe-5596-4ddd-89eb-8ca7dc46a56d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:34.108778 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a9d89fe-5596-4ddd-89eb-8ca7dc46a56d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:34.109246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a9d89fe-5596-4ddd-89eb-8ca7dc46a56d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:34.324165 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3a9d89fe-5596-4ddd-89eb-8ca7dc46a56d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:34.333908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3a9d89fe-5596-4ddd-89eb-8ca7dc46a56d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1522 microversion: 2.1 time: 0.238159 Jan 28 01:58:34.335055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 143/285] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:34 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:34.352117 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ca2038ce-3b23-4224-9e2d-4dfe9b99b572 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:34.354072 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ca2038ce-3b23-4224-9e2d-4dfe9b99b572 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:34.362182 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca2038ce-3b23-4224-9e2d-4dfe9b99b572 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:34.362757 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca2038ce-3b23-4224-9e2d-4dfe9b99b572 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:34.363760 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca2038ce-3b23-4224-9e2d-4dfe9b99b572 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:34.364384 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca2038ce-3b23-4224-9e2d-4dfe9b99b572 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:34.433379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca2038ce-3b23-4224-9e2d-4dfe9b99b572 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:34.446575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ca2038ce-3b23-4224-9e2d-4dfe9b99b572 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1270 microversion: 2.1 time: 0.109762 Jan 28 01:58:34.447949 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 144/286] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:34 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:35.372991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-16df5f0f-cf37-451c-8016-4d374f409f86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:35.374478 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-16df5f0f-cf37-451c-8016-4d374f409f86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:35.380774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-16df5f0f-cf37-451c-8016-4d374f409f86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:35.381423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-16df5f0f-cf37-451c-8016-4d374f409f86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:35.382614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-16df5f0f-cf37-451c-8016-4d374f409f86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:35.386260 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-16df5f0f-cf37-451c-8016-4d374f409f86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:35.607493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-16df5f0f-cf37-451c-8016-4d374f409f86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:35.621250 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-16df5f0f-cf37-451c-8016-4d374f409f86 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1502 microversion: 2.1 time: 0.253105 Jan 28 01:58:35.622133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 145/287] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:35 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1502 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:35.638651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-54de1f3e-7e4b-460c-8702-87423f78d8ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:35.639348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-54de1f3e-7e4b-460c-8702-87423f78d8ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:35.650752 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54de1f3e-7e4b-460c-8702-87423f78d8ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:35.652606 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54de1f3e-7e4b-460c-8702-87423f78d8ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:35.654531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54de1f3e-7e4b-460c-8702-87423f78d8ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:35.655679 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54de1f3e-7e4b-460c-8702-87423f78d8ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:35.733436 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-54de1f3e-7e4b-460c-8702-87423f78d8ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:35.745190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-54de1f3e-7e4b-460c-8702-87423f78d8ea tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1270 microversion: 2.1 time: 0.117157 Jan 28 01:58:35.745190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 146/288] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:35 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:35.765546 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8f2364db-ce9a-4757-baaf-d4feccb2d989 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:35.769724 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8f2364db-ce9a-4757-baaf-d4feccb2d989 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:35.777295 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f2364db-ce9a-4757-baaf-d4feccb2d989 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:35.777747 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f2364db-ce9a-4757-baaf-d4feccb2d989 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:35.779095 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f2364db-ce9a-4757-baaf-d4feccb2d989 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:35.779552 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f2364db-ce9a-4757-baaf-d4feccb2d989 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:35.942307 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8f2364db-ce9a-4757-baaf-d4feccb2d989 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:35.952556 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8f2364db-ce9a-4757-baaf-d4feccb2d989 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1516 microversion: 2.1 time: 0.209590 Jan 28 01:58:35.953273 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 147/289] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:35 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1516 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:36.760848 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0358b173-5f19-4512-a3dc-cd84160ffef1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:36.761574 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0358b173-5f19-4512-a3dc-cd84160ffef1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:36.768624 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0358b173-5f19-4512-a3dc-cd84160ffef1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:36.769103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0358b173-5f19-4512-a3dc-cd84160ffef1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:36.769883 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0358b173-5f19-4512-a3dc-cd84160ffef1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:36.770316 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0358b173-5f19-4512-a3dc-cd84160ffef1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:36.832924 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0358b173-5f19-4512-a3dc-cd84160ffef1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:36.840146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0358b173-5f19-4512-a3dc-cd84160ffef1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1270 microversion: 2.1 time: 0.082915 Jan 28 01:58:36.840719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 148/290] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:36 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:37.078373 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7ec149e6-d470-4256-898c-bc7775539afe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28594 microversion: 2.20 time: 3.092432 Jan 28 01:58:37.079089 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 143/291] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:33 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28594 bytes in 3094 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:37.858420 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-86c9cb60-4886-4ca1-b3bf-7806ccd56348 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:37.859104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-86c9cb60-4886-4ca1-b3bf-7806ccd56348 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:37.865407 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-86c9cb60-4886-4ca1-b3bf-7806ccd56348 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:37.866198 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-86c9cb60-4886-4ca1-b3bf-7806ccd56348 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:37.867202 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-86c9cb60-4886-4ca1-b3bf-7806ccd56348 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:37.867881 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-86c9cb60-4886-4ca1-b3bf-7806ccd56348 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:37.942246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-86c9cb60-4886-4ca1-b3bf-7806ccd56348 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:37.949809 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-86c9cb60-4886-4ca1-b3bf-7806ccd56348 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1276 microversion: 2.1 time: 0.095827 Jan 28 01:58:37.950795 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 149/292] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:37 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:38.090702 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1410c4fc-fc1c-4652-a0cc-4bd4ad4d7b3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:38.093180 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1410c4fc-fc1c-4652-a0cc-4bd4ad4d7b3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:38.099845 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1410c4fc-fc1c-4652-a0cc-4bd4ad4d7b3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:38.100421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1410c4fc-fc1c-4652-a0cc-4bd4ad4d7b3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:38.101330 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1410c4fc-fc1c-4652-a0cc-4bd4ad4d7b3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:38.101829 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1410c4fc-fc1c-4652-a0cc-4bd4ad4d7b3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:38.234162 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1410c4fc-fc1c-4652-a0cc-4bd4ad4d7b3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28594 microversion: 2.20 time: 0.147507 Jan 28 01:58:38.239381 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 144/293] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:38 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:38.967409 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b88c438c-bd2c-4df2-94c3-d51ea2d8814d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:38.968037 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b88c438c-bd2c-4df2-94c3-d51ea2d8814d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:38.973966 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b88c438c-bd2c-4df2-94c3-d51ea2d8814d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:38.974416 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b88c438c-bd2c-4df2-94c3-d51ea2d8814d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:38.975234 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b88c438c-bd2c-4df2-94c3-d51ea2d8814d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:38.975671 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b88c438c-bd2c-4df2-94c3-d51ea2d8814d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:39.010440 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-ff605651-a3c2-4ad8-a813-417f85475db8 req-cdb9a44b-4552-4be5-bdcd-1cf99f9e816a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae16871-7072-45bc-9498-b2187c59cb1f", "tag": "2d4ca6b9-07ff-4d2f-a74f-39ee5aa53643"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:39.012597 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:58:39.012597 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:58:39.021555 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ff605651-a3c2-4ad8-a813-417f85475db8 req-cdb9a44b-4552-4be5-bdcd-1cf99f9e816a service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:39.022013 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ff605651-a3c2-4ad8-a813-417f85475db8 req-cdb9a44b-4552-4be5-bdcd-1cf99f9e816a service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:39.033789 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-ff605651-a3c2-4ad8-a813-417f85475db8 req-cdb9a44b-4552-4be5-bdcd-1cf99f9e816a service nova] Creating event network-changed:2d4ca6b9-07ff-4d2f-a74f-39ee5aa53643 for instance 9ae16871-7072-45bc-9498-b2187c59cb1f on hv-cinder-82497 Jan 28 01:58:39.038547 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-ff605651-a3c2-4ad8-a813-417f85475db8 req-cdb9a44b-4552-4be5-bdcd-1cf99f9e816a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034208 Jan 28 01:58:39.039173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 145/294] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:58:39.147237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b88c438c-bd2c-4df2-94c3-d51ea2d8814d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:39.155950 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b88c438c-bd2c-4df2-94c3-d51ea2d8814d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.192243 Jan 28 01:58:39.156534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 150/295] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:38 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:39.247079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-31dc8580-3626-412a-ada6-3179e0d8b3b7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:39.249027 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-31dc8580-3626-412a-ada6-3179e0d8b3b7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:39.255904 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-31dc8580-3626-412a-ada6-3179e0d8b3b7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:39.256348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-31dc8580-3626-412a-ada6-3179e0d8b3b7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:39.257236 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-31dc8580-3626-412a-ada6-3179e0d8b3b7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:39.257681 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-31dc8580-3626-412a-ada6-3179e0d8b3b7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:39.394228 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-31dc8580-3626-412a-ada6-3179e0d8b3b7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28594 microversion: 2.20 time: 0.151045 Jan 28 01:58:39.395016 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 146/296] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:39 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:40.172807 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-edb51145-c9f7-4b59-9088-2a4e93f10139 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:40.173441 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-edb51145-c9f7-4b59-9088-2a4e93f10139 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:40.179262 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-edb51145-c9f7-4b59-9088-2a4e93f10139 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:40.179702 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-edb51145-c9f7-4b59-9088-2a4e93f10139 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:40.180470 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-edb51145-c9f7-4b59-9088-2a4e93f10139 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:40.180925 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-edb51145-c9f7-4b59-9088-2a4e93f10139 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:40.304524 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-edb51145-c9f7-4b59-9088-2a4e93f10139 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:40.312924 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-edb51145-c9f7-4b59-9088-2a4e93f10139 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.144202 Jan 28 01:58:40.313595 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 151/297] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:40 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:40.408298 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-44b9d699-eb02-4312-a71d-1d8f43db927e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:40.409491 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-44b9d699-eb02-4312-a71d-1d8f43db927e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:40.415699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44b9d699-eb02-4312-a71d-1d8f43db927e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:40.416260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44b9d699-eb02-4312-a71d-1d8f43db927e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:40.426461 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44b9d699-eb02-4312-a71d-1d8f43db927e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:40.426461 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44b9d699-eb02-4312-a71d-1d8f43db927e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:40.627216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-66be3aba-261b-4205-ae8a-bf1968886247 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:40.628132 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-66be3aba-261b-4205-ae8a-bf1968886247 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:40.633943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66be3aba-261b-4205-ae8a-bf1968886247 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:40.634385 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66be3aba-261b-4205-ae8a-bf1968886247 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:40.635157 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66be3aba-261b-4205-ae8a-bf1968886247 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:40.635591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66be3aba-261b-4205-ae8a-bf1968886247 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:40.660621 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-66be3aba-261b-4205-ae8a-bf1968886247 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lazy-loading 'flavor' on Instance uuid d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:58:40.779873 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-66be3aba-261b-4205-ae8a-bf1968886247 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/action" status: 200 len: 32 microversion: 2.1 time: 0.156268 Jan 28 01:58:40.784581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 152/298] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 01:58:40 2022] POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:58:40.790590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3f32ed64-00bf-4c77-8745-f8762bc8baec tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:40.791304 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3f32ed64-00bf-4c77-8745-f8762bc8baec tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:40.799850 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f32ed64-00bf-4c77-8745-f8762bc8baec tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:40.801465 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f32ed64-00bf-4c77-8745-f8762bc8baec tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:40.801465 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f32ed64-00bf-4c77-8745-f8762bc8baec tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:40.801670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f32ed64-00bf-4c77-8745-f8762bc8baec tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:40.937293 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3f32ed64-00bf-4c77-8745-f8762bc8baec tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:40.946126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3f32ed64-00bf-4c77-8745-f8762bc8baec tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.159781 Jan 28 01:58:40.946853 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 153/299] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:40 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:41.330463 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-156c0752-fd49-4f34-bece-9580bb1fbd97 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:41.331405 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-156c0752-fd49-4f34-bece-9580bb1fbd97 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:41.336878 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-156c0752-fd49-4f34-bece-9580bb1fbd97 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:41.337322 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-156c0752-fd49-4f34-bece-9580bb1fbd97 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:41.338202 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-156c0752-fd49-4f34-bece-9580bb1fbd97 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:41.338514 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-156c0752-fd49-4f34-bece-9580bb1fbd97 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:41.465655 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-156c0752-fd49-4f34-bece-9580bb1fbd97 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:41.476988 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-156c0752-fd49-4f34-bece-9580bb1fbd97 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.147999 Jan 28 01:58:41.477937 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 154/300] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:41 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:41.963789 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7949798d-be2d-4f3d-bbcd-e6ef10f30ade tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:41.964310 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7949798d-be2d-4f3d-bbcd-e6ef10f30ade tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:41.970386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7949798d-be2d-4f3d-bbcd-e6ef10f30ade tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:41.970827 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7949798d-be2d-4f3d-bbcd-e6ef10f30ade tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:41.971691 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7949798d-be2d-4f3d-bbcd-e6ef10f30ade tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:41.972126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7949798d-be2d-4f3d-bbcd-e6ef10f30ade tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:42.099446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7949798d-be2d-4f3d-bbcd-e6ef10f30ade tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:42.107343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7949798d-be2d-4f3d-bbcd-e6ef10f30ade tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.146669 Jan 28 01:58:42.107910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 155/301] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:41 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:42.493457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-100d7c64-86d1-48c7-b5be-67bcd11830ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:42.494085 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-100d7c64-86d1-48c7-b5be-67bcd11830ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:42.499899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-100d7c64-86d1-48c7-b5be-67bcd11830ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:42.500348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-100d7c64-86d1-48c7-b5be-67bcd11830ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:42.501174 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-100d7c64-86d1-48c7-b5be-67bcd11830ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:42.501787 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-100d7c64-86d1-48c7-b5be-67bcd11830ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:42.642423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-100d7c64-86d1-48c7-b5be-67bcd11830ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:42.649746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-100d7c64-86d1-48c7-b5be-67bcd11830ee tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.160082 Jan 28 01:58:42.650306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 156/302] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:42 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:43.124951 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-092e0e84-dc05-44a9-9733-f880e2ea8102 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:43.125561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-092e0e84-dc05-44a9-9733-f880e2ea8102 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:43.131575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-092e0e84-dc05-44a9-9733-f880e2ea8102 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:43.132021 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-092e0e84-dc05-44a9-9733-f880e2ea8102 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:43.132790 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-092e0e84-dc05-44a9-9733-f880e2ea8102 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:43.133252 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-092e0e84-dc05-44a9-9733-f880e2ea8102 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:43.260208 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-092e0e84-dc05-44a9-9733-f880e2ea8102 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:43.268398 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-092e0e84-dc05-44a9-9733-f880e2ea8102 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.147998 Jan 28 01:58:43.269077 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 157/303] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:43 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:43.539424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-44b9d699-eb02-4312-a71d-1d8f43db927e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28594 microversion: 2.20 time: 3.135710 Jan 28 01:58:43.540339 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 147/304] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:40 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28594 bytes in 3138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:43.667182 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-38f73adc-7ece-4ad9-abf0-785f427e2977 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:43.668942 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-38f73adc-7ece-4ad9-abf0-785f427e2977 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:43.677655 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38f73adc-7ece-4ad9-abf0-785f427e2977 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:43.678838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38f73adc-7ece-4ad9-abf0-785f427e2977 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:43.679867 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38f73adc-7ece-4ad9-abf0-785f427e2977 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:43.680764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38f73adc-7ece-4ad9-abf0-785f427e2977 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:43.896350 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-38f73adc-7ece-4ad9-abf0-785f427e2977 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:43.906084 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-38f73adc-7ece-4ad9-abf0-785f427e2977 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.242436 Jan 28 01:58:43.907575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 158/305] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:43 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:44.286376 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0f148db7-6116-44c5-8572-635d6be273d1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:44.287122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0f148db7-6116-44c5-8572-635d6be273d1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:44.293601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f148db7-6116-44c5-8572-635d6be273d1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:44.295174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f148db7-6116-44c5-8572-635d6be273d1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:44.296034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f148db7-6116-44c5-8572-635d6be273d1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:44.296473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f148db7-6116-44c5-8572-635d6be273d1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:44.479026 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0f148db7-6116-44c5-8572-635d6be273d1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:44.487025 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0f148db7-6116-44c5-8572-635d6be273d1 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.204774 Jan 28 01:58:44.487592 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 148/306] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:44 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:44.554900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-afcaf16b-7a0c-4060-b72e-a55c05c841cc tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:44.556031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-afcaf16b-7a0c-4060-b72e-a55c05c841cc tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:44.564622 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-afcaf16b-7a0c-4060-b72e-a55c05c841cc tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:44.565358 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-afcaf16b-7a0c-4060-b72e-a55c05c841cc tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:44.566396 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-afcaf16b-7a0c-4060-b72e-a55c05c841cc tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:44.566964 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-afcaf16b-7a0c-4060-b72e-a55c05c841cc tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:44.692014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-afcaf16b-7a0c-4060-b72e-a55c05c841cc tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 28609 microversion: 2.20 time: 0.143855 Jan 28 01:58:44.692980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 159/307] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:44 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 28609 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:44.924777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c078d134-d5f5-4296-bf49-67aa0445cea0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:44.925299 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c078d134-d5f5-4296-bf49-67aa0445cea0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:44.937481 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c078d134-d5f5-4296-bf49-67aa0445cea0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:44.938000 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c078d134-d5f5-4296-bf49-67aa0445cea0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:44.938855 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c078d134-d5f5-4296-bf49-67aa0445cea0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:44.939363 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c078d134-d5f5-4296-bf49-67aa0445cea0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:45.235079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c078d134-d5f5-4296-bf49-67aa0445cea0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:45.244004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c078d134-d5f5-4296-bf49-67aa0445cea0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.324398 Jan 28 01:58:45.253491 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 149/308] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:44 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:45.508202 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-220f809a-c20b-4087-88b4-a55bffcf4b70 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:45.508916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-220f809a-c20b-4087-88b4-a55bffcf4b70 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:45.516942 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-220f809a-c20b-4087-88b4-a55bffcf4b70 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:45.517460 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-220f809a-c20b-4087-88b4-a55bffcf4b70 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:45.518348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-220f809a-c20b-4087-88b4-a55bffcf4b70 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:45.518794 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-220f809a-c20b-4087-88b4-a55bffcf4b70 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:45.659172 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-220f809a-c20b-4087-88b4-a55bffcf4b70 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:45.667059 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-220f809a-c20b-4087-88b4-a55bffcf4b70 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.162708 Jan 28 01:58:45.667547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 160/309] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:45 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:45.704174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-59cb485c-5b46-46cf-b14a-02e7106e8533 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:45.705121 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-59cb485c-5b46-46cf-b14a-02e7106e8533 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:45.712733 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59cb485c-5b46-46cf-b14a-02e7106e8533 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:45.713285 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59cb485c-5b46-46cf-b14a-02e7106e8533 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:45.714059 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59cb485c-5b46-46cf-b14a-02e7106e8533 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:45.714494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59cb485c-5b46-46cf-b14a-02e7106e8533 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:45.847817 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-59cb485c-5b46-46cf-b14a-02e7106e8533 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 29901 microversion: 2.20 time: 0.148040 Jan 28 01:58:45.848479 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 150/310] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:45 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 29901 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:46.259573 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bdd902e9-33b3-447a-b0fb-f9e3affd4363 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:46.260189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bdd902e9-33b3-447a-b0fb-f9e3affd4363 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:46.267256 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bdd902e9-33b3-447a-b0fb-f9e3affd4363 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:46.267704 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bdd902e9-33b3-447a-b0fb-f9e3affd4363 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:46.268480 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bdd902e9-33b3-447a-b0fb-f9e3affd4363 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:46.268946 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bdd902e9-33b3-447a-b0fb-f9e3affd4363 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:46.393602 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bdd902e9-33b3-447a-b0fb-f9e3affd4363 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:46.401055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bdd902e9-33b3-447a-b0fb-f9e3affd4363 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.145016 Jan 28 01:58:46.401876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 161/311] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:46 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:46.685790 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fd55eb53-3655-47a2-8dac-16360e1fb110 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:46.687178 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fd55eb53-3655-47a2-8dac-16360e1fb110 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:46.695051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd55eb53-3655-47a2-8dac-16360e1fb110 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:46.696071 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd55eb53-3655-47a2-8dac-16360e1fb110 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:46.697338 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd55eb53-3655-47a2-8dac-16360e1fb110 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:46.698396 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd55eb53-3655-47a2-8dac-16360e1fb110 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:46.863216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-258920e5-b761-4492-9833-1fa895c12e53 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:46.864139 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-258920e5-b761-4492-9833-1fa895c12e53 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:46.873520 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-258920e5-b761-4492-9833-1fa895c12e53 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:46.874796 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-258920e5-b761-4492-9833-1fa895c12e53 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:46.876574 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-258920e5-b761-4492-9833-1fa895c12e53 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:46.877646 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-258920e5-b761-4492-9833-1fa895c12e53 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:46.885789 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fd55eb53-3655-47a2-8dac-16360e1fb110 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:46.898857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fd55eb53-3655-47a2-8dac-16360e1fb110 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.218085 Jan 28 01:58:46.899424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 151/312] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:46 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:47.020321 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-258920e5-b761-4492-9833-1fa895c12e53 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 30809 microversion: 2.20 time: 0.163766 Jan 28 01:58:47.024624 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 162/313] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:46 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 30809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:47.419771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-04fd5615-1979-4859-979d-2aee6071f5cb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:47.420474 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-04fd5615-1979-4859-979d-2aee6071f5cb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:47.427528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04fd5615-1979-4859-979d-2aee6071f5cb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:47.428083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04fd5615-1979-4859-979d-2aee6071f5cb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:47.428984 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04fd5615-1979-4859-979d-2aee6071f5cb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:47.429494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04fd5615-1979-4859-979d-2aee6071f5cb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:47.585721 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-04fd5615-1979-4859-979d-2aee6071f5cb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:47.595543 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-04fd5615-1979-4859-979d-2aee6071f5cb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.180845 Jan 28 01:58:47.596460 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 152/314] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:47 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:47.918755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-548d5299-4775-48a2-883e-7fd847a5ee64 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:47.920171 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-548d5299-4775-48a2-883e-7fd847a5ee64 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:47.927877 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-548d5299-4775-48a2-883e-7fd847a5ee64 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:47.928512 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-548d5299-4775-48a2-883e-7fd847a5ee64 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:47.929536 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-548d5299-4775-48a2-883e-7fd847a5ee64 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:47.930210 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-548d5299-4775-48a2-883e-7fd847a5ee64 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:47.968491 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-d8190132-bc92-48dc-86e8-b53a2f35d028 req-6b1240fe-57f6-48c3-b0c3-afa049380965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae16871-7072-45bc-9498-b2187c59cb1f", "name": "network-vif-plugged", "status": "completed", "tag": "2d4ca6b9-07ff-4d2f-a74f-39ee5aa53643"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:47.971332 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:58:47.971332 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:58:47.990605 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d8190132-bc92-48dc-86e8-b53a2f35d028 req-6b1240fe-57f6-48c3-b0c3-afa049380965 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:47.991417 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d8190132-bc92-48dc-86e8-b53a2f35d028 req-6b1240fe-57f6-48c3-b0c3-afa049380965 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:48.006397 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-d8190132-bc92-48dc-86e8-b53a2f35d028 req-6b1240fe-57f6-48c3-b0c3-afa049380965 service nova] Creating event network-vif-plugged:2d4ca6b9-07ff-4d2f-a74f-39ee5aa53643 for instance 9ae16871-7072-45bc-9498-b2187c59cb1f on hv-cinder-82497 Jan 28 01:58:48.019159 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-d8190132-bc92-48dc-86e8-b53a2f35d028 req-6b1240fe-57f6-48c3-b0c3-afa049380965 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055078 Jan 28 01:58:48.020561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 153/315] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:48.036084 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-536631e6-4910-4a5e-bc7b-780a866a412e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:48.049080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-536631e6-4910-4a5e-bc7b-780a866a412e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:48.072585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-536631e6-4910-4a5e-bc7b-780a866a412e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:48.078763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-536631e6-4910-4a5e-bc7b-780a866a412e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:48.086868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-536631e6-4910-4a5e-bc7b-780a866a412e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:48.087369 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-536631e6-4910-4a5e-bc7b-780a866a412e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:48.327414 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-548d5299-4775-48a2-883e-7fd847a5ee64 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:48.334849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-548d5299-4775-48a2-883e-7fd847a5ee64 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.420344 Jan 28 01:58:48.344866 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 163/316] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:47 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:48.612749 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5e64b21a-ffc5-46d7-ad12-77955e92dadb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:48.613492 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5e64b21a-ffc5-46d7-ad12-77955e92dadb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:48.620189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e64b21a-ffc5-46d7-ad12-77955e92dadb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:48.620716 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e64b21a-ffc5-46d7-ad12-77955e92dadb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:48.621592 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e64b21a-ffc5-46d7-ad12-77955e92dadb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:48.622103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e64b21a-ffc5-46d7-ad12-77955e92dadb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:48.794432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5e64b21a-ffc5-46d7-ad12-77955e92dadb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:48.803795 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5e64b21a-ffc5-46d7-ad12-77955e92dadb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.194767 Jan 28 01:58:48.812945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 164/317] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:48 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:49.352018 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8f50edb7-9640-4319-8309-70032d52eb40 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:49.353384 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8f50edb7-9640-4319-8309-70032d52eb40 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:49.361159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f50edb7-9640-4319-8309-70032d52eb40 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:49.361651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f50edb7-9640-4319-8309-70032d52eb40 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:49.362562 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f50edb7-9640-4319-8309-70032d52eb40 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:49.363000 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f50edb7-9640-4319-8309-70032d52eb40 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:49.605276 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8f50edb7-9640-4319-8309-70032d52eb40 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:49.619996 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8f50edb7-9640-4319-8309-70032d52eb40 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.270788 Jan 28 01:58:49.621251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 165/318] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:49 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:49.825886 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6e3ca1a4-bb47-47a5-9ea9-00d53d9de4b6 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:49.830649 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6e3ca1a4-bb47-47a5-9ea9-00d53d9de4b6 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:49.838804 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6e3ca1a4-bb47-47a5-9ea9-00d53d9de4b6 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:49.839377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6e3ca1a4-bb47-47a5-9ea9-00d53d9de4b6 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:49.840380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6e3ca1a4-bb47-47a5-9ea9-00d53d9de4b6 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:49.841457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6e3ca1a4-bb47-47a5-9ea9-00d53d9de4b6 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:50.117611 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6e3ca1a4-bb47-47a5-9ea9-00d53d9de4b6 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:50.132180 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6e3ca1a4-bb47-47a5-9ea9-00d53d9de4b6 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.313187 Jan 28 01:58:50.132845 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 166/319] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:49 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:50.641361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-20e8112f-8e3d-445c-8244-b14d6f94f0c3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:50.642707 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-20e8112f-8e3d-445c-8244-b14d6f94f0c3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:50.650108 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20e8112f-8e3d-445c-8244-b14d6f94f0c3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:50.650831 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20e8112f-8e3d-445c-8244-b14d6f94f0c3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:50.652078 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20e8112f-8e3d-445c-8244-b14d6f94f0c3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:50.653037 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20e8112f-8e3d-445c-8244-b14d6f94f0c3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:50.908546 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-20e8112f-8e3d-445c-8244-b14d6f94f0c3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:50.918146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-20e8112f-8e3d-445c-8244-b14d6f94f0c3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.282052 Jan 28 01:58:50.919673 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 167/320] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:50 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:51.161932 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9f99fe5e-dde8-4762-b9a4-7f055bd61068 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:51.162740 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9f99fe5e-dde8-4762-b9a4-7f055bd61068 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:51.171591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f99fe5e-dde8-4762-b9a4-7f055bd61068 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:51.172048 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f99fe5e-dde8-4762-b9a4-7f055bd61068 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:51.173060 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f99fe5e-dde8-4762-b9a4-7f055bd61068 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:51.173642 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f99fe5e-dde8-4762-b9a4-7f055bd61068 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:51.209329 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-536631e6-4910-4a5e-bc7b-780a866a412e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 33494 microversion: 2.20 time: 3.180539 Jan 28 01:58:51.210466 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 154/321] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:48 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 33494 bytes in 3183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:51.411021 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9f99fe5e-dde8-4762-b9a4-7f055bd61068 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:51.420731 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9f99fe5e-dde8-4762-b9a4-7f055bd61068 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.262757 Jan 28 01:58:51.421779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 168/322] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:51 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:51.936885 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-88281ea1-bbcc-4c60-8d74-79efa6e0c3e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:51.937605 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-88281ea1-bbcc-4c60-8d74-79efa6e0c3e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:51.967430 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88281ea1-bbcc-4c60-8d74-79efa6e0c3e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:51.968060 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88281ea1-bbcc-4c60-8d74-79efa6e0c3e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:51.969070 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88281ea1-bbcc-4c60-8d74-79efa6e0c3e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:51.969756 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88281ea1-bbcc-4c60-8d74-79efa6e0c3e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:52.225854 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f137f871-1b12-4157-a297-906adbcda479 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:52.227886 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f137f871-1b12-4157-a297-906adbcda479 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:52.253036 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f137f871-1b12-4157-a297-906adbcda479 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:52.254113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f137f871-1b12-4157-a297-906adbcda479 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:52.258641 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f137f871-1b12-4157-a297-906adbcda479 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:52.260552 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f137f871-1b12-4157-a297-906adbcda479 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:52.432497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-88281ea1-bbcc-4c60-8d74-79efa6e0c3e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:52.445821 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-88281ea1-bbcc-4c60-8d74-79efa6e0c3e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.513791 Jan 28 01:58:52.446527 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 155/323] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:51 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:52.459264 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-be6dc17b-2012-4ce2-91f2-10a35bfb0e45 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:52.459884 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-be6dc17b-2012-4ce2-91f2-10a35bfb0e45 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:52.469320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be6dc17b-2012-4ce2-91f2-10a35bfb0e45 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:52.469765 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be6dc17b-2012-4ce2-91f2-10a35bfb0e45 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:52.471165 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be6dc17b-2012-4ce2-91f2-10a35bfb0e45 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:52.471632 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be6dc17b-2012-4ce2-91f2-10a35bfb0e45 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:52.997816 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-be6dc17b-2012-4ce2-91f2-10a35bfb0e45 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:53.009313 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-be6dc17b-2012-4ce2-91f2-10a35bfb0e45 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.554662 Jan 28 01:58:53.009953 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 156/324] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:52 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:53.364410 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f137f871-1b12-4157-a297-906adbcda479 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 34749 microversion: 2.20 time: 1.144789 Jan 28 01:58:53.368629 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 169/325] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:52 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 34749 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:53.468621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-723b92a8-e663-4c8b-bc70-7ad553ce9349 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:53.469368 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-723b92a8-e663-4c8b-bc70-7ad553ce9349 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:53.478668 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-723b92a8-e663-4c8b-bc70-7ad553ce9349 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:53.479220 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-723b92a8-e663-4c8b-bc70-7ad553ce9349 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:53.480206 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-723b92a8-e663-4c8b-bc70-7ad553ce9349 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:53.480646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-723b92a8-e663-4c8b-bc70-7ad553ce9349 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:53.728786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-723b92a8-e663-4c8b-bc70-7ad553ce9349 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:53.743483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-723b92a8-e663-4c8b-bc70-7ad553ce9349 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.279427 Jan 28 01:58:53.744753 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 157/326] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:53 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:54.026824 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6382f352-ba17-4bc7-8eea-e9caf2028267 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:54.027922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6382f352-ba17-4bc7-8eea-e9caf2028267 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:54.036554 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6382f352-ba17-4bc7-8eea-e9caf2028267 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:54.037344 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6382f352-ba17-4bc7-8eea-e9caf2028267 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:54.038334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6382f352-ba17-4bc7-8eea-e9caf2028267 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:54.038949 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6382f352-ba17-4bc7-8eea-e9caf2028267 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:54.317264 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6382f352-ba17-4bc7-8eea-e9caf2028267 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:54.326486 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6382f352-ba17-4bc7-8eea-e9caf2028267 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1318 microversion: 2.1 time: 0.303961 Jan 28 01:58:54.338104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 170/327] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:54 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:54.386933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5eb10bce-8fc2-404d-971a-e7d3532d08f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:54.388507 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5eb10bce-8fc2-404d-971a-e7d3532d08f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:54.395274 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5eb10bce-8fc2-404d-971a-e7d3532d08f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:54.395978 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5eb10bce-8fc2-404d-971a-e7d3532d08f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:54.396850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5eb10bce-8fc2-404d-971a-e7d3532d08f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:54.397248 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5eb10bce-8fc2-404d-971a-e7d3532d08f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:54.543086 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5eb10bce-8fc2-404d-971a-e7d3532d08f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 35136 microversion: 2.20 time: 0.159703 Jan 28 01:58:54.555502 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 158/328] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:54 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 35136 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:54.767770 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-19351d01-9b7b-4c04-bcfb-011ef0dce935 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:54.770154 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-19351d01-9b7b-4c04-bcfb-011ef0dce935 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:54.795192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19351d01-9b7b-4c04-bcfb-011ef0dce935 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:54.795780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19351d01-9b7b-4c04-bcfb-011ef0dce935 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:54.799736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19351d01-9b7b-4c04-bcfb-011ef0dce935 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:54.800766 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19351d01-9b7b-4c04-bcfb-011ef0dce935 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:55.081051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-19351d01-9b7b-4c04-bcfb-011ef0dce935 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:55.088585 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-19351d01-9b7b-4c04-bcfb-011ef0dce935 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.330850 Jan 28 01:58:55.101361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 171/329] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:54 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:55.208652 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1892348732", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-363378608", "security_groups": [{"name": "tempest-secgroup-smoke-1260954673"}], "block_device_mapping_v2": [{"uuid": "8fa68b2b-0933-4c13-98ce-b0bd05707f92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41f7abf6-a2c1-4ce5-83fe-68e8627532be"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:55.344512 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e933992b-c819-4ff2-b3f8-b61469757e96 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:55.345417 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e933992b-c819-4ff2-b3f8-b61469757e96 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:55.352096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e933992b-c819-4ff2-b3f8-b61469757e96 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:55.352613 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e933992b-c819-4ff2-b3f8-b61469757e96 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:55.353499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e933992b-c819-4ff2-b3f8-b61469757e96 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:55.354024 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e933992b-c819-4ff2-b3f8-b61469757e96 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:55.377029 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] validate_networks() for [('41f7abf6-a2c1-4ce5-83fe-68e8627532be', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:58:55.750343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e933992b-c819-4ff2-b3f8-b61469757e96 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:55.761184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e933992b-c819-4ff2-b3f8-b61469757e96 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1509 microversion: 2.1 time: 0.420540 Jan 28 01:58:55.780048 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 172/330] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:55 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1509 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:55.788746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9edcbcc3-6ad7-4607-94d6-8e87c06d7938 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:55.790491 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9edcbcc3-6ad7-4607-94d6-8e87c06d7938 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:55.802117 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9edcbcc3-6ad7-4607-94d6-8e87c06d7938 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:55.802750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9edcbcc3-6ad7-4607-94d6-8e87c06d7938 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:55.804097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9edcbcc3-6ad7-4607-94d6-8e87c06d7938 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:55.806881 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9edcbcc3-6ad7-4607-94d6-8e87c06d7938 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:55.975823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9edcbcc3-6ad7-4607-94d6-8e87c06d7938 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 37234 microversion: 2.20 time: 0.193465 Jan 28 01:58:55.980686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 173/331] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:55 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 37234 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:56.108591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fb1d86c3-4544-4d13-916b-e606b39dcf5c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:56.109508 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fb1d86c3-4544-4d13-916b-e606b39dcf5c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:56.120884 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb1d86c3-4544-4d13-916b-e606b39dcf5c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:56.122030 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb1d86c3-4544-4d13-916b-e606b39dcf5c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:56.123861 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb1d86c3-4544-4d13-916b-e606b39dcf5c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:56.124527 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb1d86c3-4544-4d13-916b-e606b39dcf5c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:56.162976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:58:56.164152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:58:56.165415 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:58:56.166203 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:58:56.166772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:58:56.184573 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:56.188378 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:56.192039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:56.196915 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:56.273132 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for project 6e15e80496d946b4ba64c95751ebc354. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:58:56.290387 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for user cd9cb4ec35524e859b828892c95130e7 and project 6e15e80496d946b4ba64c95751ebc354. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:58:56.507085 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fb1d86c3-4544-4d13-916b-e606b39dcf5c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:56.522220 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fb1d86c3-4544-4d13-916b-e606b39dcf5c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.417930 Jan 28 01:58:56.537007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 174/332] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:56 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:56.547239 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:58:56.549855 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fa68b2b-0933-4c13-98ce-b0bd05707f92',volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:58:56.806672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fcf0a194-d872-4df2-a877-ef37da9ece8e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.602187 Jan 28 01:58:56.810189 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 159/333] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:58:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 01:58:56.824908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-955771e9-89dd-4ac3-8740-1725567bbe7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:56.830473 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-955771e9-89dd-4ac3-8740-1725567bbe7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:56.991664 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-932283b5-53cf-4b3b-896a-6ba095a2bacd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:56.992918 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-932283b5-53cf-4b3b-896a-6ba095a2bacd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:57.006550 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-932283b5-53cf-4b3b-896a-6ba095a2bacd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:57.007397 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-932283b5-53cf-4b3b-896a-6ba095a2bacd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:57.008700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-932283b5-53cf-4b3b-896a-6ba095a2bacd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:57.009322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-932283b5-53cf-4b3b-896a-6ba095a2bacd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:57.136217 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-932283b5-53cf-4b3b-896a-6ba095a2bacd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 37940 microversion: 2.20 time: 0.150422 Jan 28 01:58:57.137128 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 160/334] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:56 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 37940 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:58:57.406395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-955771e9-89dd-4ac3-8740-1725567bbe7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:57.444476 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-955771e9-89dd-4ac3-8740-1725567bbe7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1094 microversion: 2.1 time: 0.622234 Jan 28 01:58:57.460066 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 175/335] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:56 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1094 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:57.545022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-319c2d40-e3e0-418b-ac42-45e33495c4ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:57.546548 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-319c2d40-e3e0-418b-ac42-45e33495c4ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:57.554620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-319c2d40-e3e0-418b-ac42-45e33495c4ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:57.555458 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-319c2d40-e3e0-418b-ac42-45e33495c4ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:57.556446 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-319c2d40-e3e0-418b-ac42-45e33495c4ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:57.557168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-319c2d40-e3e0-418b-ac42-45e33495c4ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:57.686370 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9995473e-eaa4-40ea-945f-0968a4a7f978 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fce54dff-4f2c-467f-a487-8185dcd7f50e"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:57.687976 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9995473e-eaa4-40ea-945f-0968a4a7f978 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:57.711401 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9995473e-eaa4-40ea-945f-0968a4a7f978 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:57.714743 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9995473e-eaa4-40ea-945f-0968a4a7f978 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:57.718278 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9995473e-eaa4-40ea-945f-0968a4a7f978 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:57.719057 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9995473e-eaa4-40ea-945f-0968a4a7f978 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:58.187620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-319c2d40-e3e0-418b-ac42-45e33495c4ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:58.200876 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-319c2d40-e3e0-418b-ac42-45e33495c4ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.660470 Jan 28 01:58:58.207014 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 161/336] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:57 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:58.231167 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-37009f88-2aa9-4413-ae8b-5bdbce546813 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:58.236111 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-37009f88-2aa9-4413-ae8b-5bdbce546813 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:58.251397 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-37009f88-2aa9-4413-ae8b-5bdbce546813 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:58.253208 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-37009f88-2aa9-4413-ae8b-5bdbce546813 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:58.255107 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-37009f88-2aa9-4413-ae8b-5bdbce546813 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:58.256362 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-37009f88-2aa9-4413-ae8b-5bdbce546813 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:58.358657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9995473e-eaa4-40ea-945f-0968a4a7f978 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680334 Jan 28 01:58:58.360325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 176/337] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 01:58:57 2022] POST /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:58.465322 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-93135e57-5d97-4473-b2e5-681ebd52155f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:58.466718 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-93135e57-5d97-4473-b2e5-681ebd52155f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:58.480281 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93135e57-5d97-4473-b2e5-681ebd52155f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:58.483468 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93135e57-5d97-4473-b2e5-681ebd52155f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:58.484323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93135e57-5d97-4473-b2e5-681ebd52155f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:58.484774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93135e57-5d97-4473-b2e5-681ebd52155f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:58.507292 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-37009f88-2aa9-4413-ae8b-5bdbce546813 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 38014 microversion: 2.20 time: 0.284759 Jan 28 01:58:58.507990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 162/338] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:58 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 38014 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:58.637173 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-93135e57-5d97-4473-b2e5-681ebd52155f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:58.647140 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-93135e57-5d97-4473-b2e5-681ebd52155f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1192 microversion: 2.1 time: 0.186083 Jan 28 01:58:58.648325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 177/339] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:58 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1192 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:59.237014 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5748a660-848e-4188-a17a-61d522cea3a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:59.238145 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5748a660-848e-4188-a17a-61d522cea3a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:59.303873 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5748a660-848e-4188-a17a-61d522cea3a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:59.304593 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5748a660-848e-4188-a17a-61d522cea3a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:59.306020 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5748a660-848e-4188-a17a-61d522cea3a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:59.306632 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5748a660-848e-4188-a17a-61d522cea3a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:59.534993 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8f391dc6-0e87-42db-a062-7656b5e3cf71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:59.537136 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8f391dc6-0e87-42db-a062-7656b5e3cf71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:59.558692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f391dc6-0e87-42db-a062-7656b5e3cf71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:59.559761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f391dc6-0e87-42db-a062-7656b5e3cf71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:59.561343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f391dc6-0e87-42db-a062-7656b5e3cf71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:59.562531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f391dc6-0e87-42db-a062-7656b5e3cf71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:59.752791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5748a660-848e-4188-a17a-61d522cea3a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:59.763927 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5748a660-848e-4188-a17a-61d522cea3a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.541595 Jan 28 01:58:59.766281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 163/340] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:59 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:59.773828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9dd008ea-01b2-4794-9429-1d90f12a2309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:59.774678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9dd008ea-01b2-4794-9429-1d90f12a2309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:58:59.787535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dd008ea-01b2-4794-9429-1d90f12a2309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:59.789239 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dd008ea-01b2-4794-9429-1d90f12a2309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:59.792831 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dd008ea-01b2-4794-9429-1d90f12a2309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:58:59.794934 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dd008ea-01b2-4794-9429-1d90f12a2309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:58:59.838957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8f391dc6-0e87-42db-a062-7656b5e3cf71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 38014 microversion: 2.20 time: 0.321551 Jan 28 01:58:59.845963 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 178/341] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:58:59 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 38014 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:58:59.936774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9dd008ea-01b2-4794-9429-1d90f12a2309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:58:59.947486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9dd008ea-01b2-4794-9429-1d90f12a2309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1210 microversion: 2.1 time: 0.179583 Jan 28 01:58:59.948400 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 164/342] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:58:59 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:00.785472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-17e5bf10-0700-4080-ba36-da0a44303efd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:00.786191 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-17e5bf10-0700-4080-ba36-da0a44303efd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:00.807238 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17e5bf10-0700-4080-ba36-da0a44303efd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:00.813019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17e5bf10-0700-4080-ba36-da0a44303efd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:00.818083 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17e5bf10-0700-4080-ba36-da0a44303efd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:00.825837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17e5bf10-0700-4080-ba36-da0a44303efd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:00.854554 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e3809c1b-cdf9-42bb-85b7-c1eff0b535c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:00.855506 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e3809c1b-cdf9-42bb-85b7-c1eff0b535c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:00.877829 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3809c1b-cdf9-42bb-85b7-c1eff0b535c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:00.878566 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3809c1b-cdf9-42bb-85b7-c1eff0b535c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:00.879583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3809c1b-cdf9-42bb-85b7-c1eff0b535c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:00.880194 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3809c1b-cdf9-42bb-85b7-c1eff0b535c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:01.157364 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e3809c1b-cdf9-42bb-85b7-c1eff0b535c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 38030 microversion: 2.20 time: 0.307571 Jan 28 01:59:01.158884 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 165/343] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:59:00 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 38030 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:59:01.178256 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-829cc6fb-4225-44a5-bc80-b3047f2b72c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:01.178990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-829cc6fb-4225-44a5-bc80-b3047f2b72c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:01.204758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-829cc6fb-4225-44a5-bc80-b3047f2b72c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:01.209530 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-829cc6fb-4225-44a5-bc80-b3047f2b72c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:01.216945 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-829cc6fb-4225-44a5-bc80-b3047f2b72c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:01.218672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-829cc6fb-4225-44a5-bc80-b3047f2b72c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:01.898441 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-17e5bf10-0700-4080-ba36-da0a44303efd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:01.944394 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-17e5bf10-0700-4080-ba36-da0a44303efd tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 1.162895 Jan 28 01:59:01.948177 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 179/344] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:00 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:02.058523 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-829cc6fb-4225-44a5-bc80-b3047f2b72c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:02.068743 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-829cc6fb-4225-44a5-bc80-b3047f2b72c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1278 microversion: 2.1 time: 0.908532 Jan 28 01:59:02.083326 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 166/345] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:01 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1278 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:02.171313 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1ef96a7a-73c4-4bbd-be13-472d535dccc3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:02.172242 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1ef96a7a-73c4-4bbd-be13-472d535dccc3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:02.193495 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1ef96a7a-73c4-4bbd-be13-472d535dccc3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:02.193495 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1ef96a7a-73c4-4bbd-be13-472d535dccc3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:02.196450 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1ef96a7a-73c4-4bbd-be13-472d535dccc3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:02.197127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1ef96a7a-73c4-4bbd-be13-472d535dccc3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:02.376299 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1ef96a7a-73c4-4bbd-be13-472d535dccc3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 200 len: 38153 microversion: 2.20 time: 0.210793 Jan 28 01:59:02.377526 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 180/346] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:59:02 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 38153 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:59:02.387180 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-448281da-3708-4547-bc2f-640ae946eb61 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:02.389306 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-448281da-3708-4547-bc2f-640ae946eb61 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:02.402579 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-448281da-3708-4547-bc2f-640ae946eb61 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:02.403047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-448281da-3708-4547-bc2f-640ae946eb61 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:02.407400 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-448281da-3708-4547-bc2f-640ae946eb61 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:02.408110 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-448281da-3708-4547-bc2f-640ae946eb61 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:02.510238 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-448281da-3708-4547-bc2f-640ae946eb61 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/ips" status: 200 len: 152 microversion: 2.20 time: 0.126451 Jan 28 01:59:02.519294 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 167/347] 10.222.0.96 () {60 vars in 1288 bytes} [Fri Jan 28 01:59:02 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/ips => generated 152 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:59:02.967436 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-18fcf5e7-0536-40a0-bfeb-ec04f4aa8236 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:02.968853 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-18fcf5e7-0536-40a0-bfeb-ec04f4aa8236 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:02.996380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18fcf5e7-0536-40a0-bfeb-ec04f4aa8236 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:03.000348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18fcf5e7-0536-40a0-bfeb-ec04f4aa8236 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:03.001838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18fcf5e7-0536-40a0-bfeb-ec04f4aa8236 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:03.007333 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18fcf5e7-0536-40a0-bfeb-ec04f4aa8236 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:03.112064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ca73f851-dc95-4845-861a-6b8aa05da869 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:03.116068 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ca73f851-dc95-4845-861a-6b8aa05da869 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:03.133774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca73f851-dc95-4845-861a-6b8aa05da869 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:03.134928 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca73f851-dc95-4845-861a-6b8aa05da869 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:03.137517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca73f851-dc95-4845-861a-6b8aa05da869 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:03.138525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca73f851-dc95-4845-861a-6b8aa05da869 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:03.814823 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ca73f851-dc95-4845-861a-6b8aa05da869 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:03.818181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-18fcf5e7-0536-40a0-bfeb-ec04f4aa8236 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:03.825615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ca73f851-dc95-4845-861a-6b8aa05da869 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1278 microversion: 2.1 time: 0.738976 Jan 28 01:59:03.840884 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 168/348] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:03 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1278 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:03.843309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-18fcf5e7-0536-40a0-bfeb-ec04f4aa8236 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.878583 Jan 28 01:59:03.844415 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 181/349] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:02 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:03.853145 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-7ab3645e-5b0b-4ed4-ac76-38088ff92878 req-d2ca8292-48d4-4a2b-a64c-de054918ba31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95db6794-9e5c-4a0e-a565-cdf17c8174c5", "tag": "a96061fe-84a7-4238-9f60-3ee0a48a23b7"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:03.855028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:03.855028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:03.864241 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-7ab3645e-5b0b-4ed4-ac76-38088ff92878 req-d2ca8292-48d4-4a2b-a64c-de054918ba31 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:03.864684 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-7ab3645e-5b0b-4ed4-ac76-38088ff92878 req-d2ca8292-48d4-4a2b-a64c-de054918ba31 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:03.920310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-7ab3645e-5b0b-4ed4-ac76-38088ff92878 req-d2ca8292-48d4-4a2b-a64c-de054918ba31 service nova] Creating event network-changed:a96061fe-84a7-4238-9f60-3ee0a48a23b7 for instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 on hv-cinder-82497 Jan 28 01:59:03.929286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-7ab3645e-5b0b-4ed4-ac76-38088ff92878 req-d2ca8292-48d4-4a2b-a64c-de054918ba31 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084584 Jan 28 01:59:03.930075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 169/350] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:04.850010 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1a1ae9fa-4b76-48f3-b636-6bb0614a171e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:04.850621 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1a1ae9fa-4b76-48f3-b636-6bb0614a171e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:04.862825 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1e88308a-7064-400d-a032-1425b2f9ae90 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:04.864464 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1e88308a-7064-400d-a032-1425b2f9ae90 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:04.877879 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e88308a-7064-400d-a032-1425b2f9ae90 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:04.878333 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e88308a-7064-400d-a032-1425b2f9ae90 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:04.879294 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a1ae9fa-4b76-48f3-b636-6bb0614a171e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:04.880023 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a1ae9fa-4b76-48f3-b636-6bb0614a171e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:04.882661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a1ae9fa-4b76-48f3-b636-6bb0614a171e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:04.883449 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a1ae9fa-4b76-48f3-b636-6bb0614a171e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:04.886887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e88308a-7064-400d-a032-1425b2f9ae90 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:04.892736 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e88308a-7064-400d-a032-1425b2f9ae90 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:05.248546 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1e88308a-7064-400d-a032-1425b2f9ae90 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:05.250839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1a1ae9fa-4b76-48f3-b636-6bb0614a171e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:05.264538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1a1ae9fa-4b76-48f3-b636-6bb0614a171e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1278 microversion: 2.1 time: 0.418103 Jan 28 01:59:05.265983 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1e88308a-7064-400d-a032-1425b2f9ae90 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.407981 Jan 28 01:59:05.266847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 170/351] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:04 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:05.279367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 182/352] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:04 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1278 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:05.591582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e3090c9e-ab29-4e52-a3aa-09de08a48522 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Action: 'create', calling method: .version_select at 0x7f523fd44dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-408487327"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:05.623079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-e3090c9e-ab29-4e52-a3aa-09de08a48522 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Getting quotas for project 50b9208765264efbb2e25f5ba4896b4a. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:59:05.627604 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-e3090c9e-ab29-4e52-a3aa-09de08a48522 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Getting quotas for user a315151d7ab945cbbbe4c88adc4b7203 and project 50b9208765264efbb2e25f5ba4896b4a. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:59:05.807320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-e3090c9e-ab29-4e52-a3aa-09de08a48522 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Getting quotas for project 50b9208765264efbb2e25f5ba4896b4a. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:59:05.812404 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-e3090c9e-ab29-4e52-a3aa-09de08a48522 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Getting quotas for user a315151d7ab945cbbbe4c88adc4b7203 and project 50b9208765264efbb2e25f5ba4896b4a. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:59:05.832166 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e3090c9e-ab29-4e52-a3aa-09de08a48522 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.554667 Jan 28 01:59:05.832783 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 171/353] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Jan 28 01:59:05 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:05.989639 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-06c31782-88f8-476a-9cda-1a47a179791d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:05.991609 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-06c31782-88f8-476a-9cda-1a47a179791d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:06.006013 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06c31782-88f8-476a-9cda-1a47a179791d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:06.006462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06c31782-88f8-476a-9cda-1a47a179791d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:06.007247 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06c31782-88f8-476a-9cda-1a47a179791d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:06.007673 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06c31782-88f8-476a-9cda-1a47a179791d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:06.073164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-06c31782-88f8-476a-9cda-1a47a179791d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lazy-loading 'flavor' on Instance uuid 7a1879ef-ae58-41eb-9c13-3f9a3988a970 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:59:06.284206 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b4f050fd-d910-49ed-8d07-4e60ed42e498 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:06.285480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b4f050fd-d910-49ed-8d07-4e60ed42e498 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:06.314460 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4f050fd-d910-49ed-8d07-4e60ed42e498 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:06.318084 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4f050fd-d910-49ed-8d07-4e60ed42e498 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:06.319122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4f050fd-d910-49ed-8d07-4e60ed42e498 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:06.323208 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4f050fd-d910-49ed-8d07-4e60ed42e498 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:06.690150 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-06c31782-88f8-476a-9cda-1a47a179791d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 202 len: 0 microversion: 2.20 time: 0.703265 Jan 28 01:59:06.693595 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 183/354] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 01:59:05 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:59:06.703149 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f7c52ff9-d8b6-4c3a-b132-985162af1b52 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:06.710031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f7c52ff9-d8b6-4c3a-b132-985162af1b52 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:06.729530 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7c52ff9-d8b6-4c3a-b132-985162af1b52 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:06.729991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7c52ff9-d8b6-4c3a-b132-985162af1b52 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:06.730793 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7c52ff9-d8b6-4c3a-b132-985162af1b52 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:06.735004 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7c52ff9-d8b6-4c3a-b132-985162af1b52 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:06.743940 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b4f050fd-d910-49ed-8d07-4e60ed42e498 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:06.761511 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b4f050fd-d910-49ed-8d07-4e60ed42e498 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1278 microversion: 2.1 time: 0.482035 Jan 28 01:59:06.774631 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 172/355] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:06 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1278 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:06.787312 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:06.791214 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:06.805010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:06.805545 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:06.806260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:06.806731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:06.995236 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f7c52ff9-d8b6-4c3a-b132-985162af1b52 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:07.010510 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f7c52ff9-d8b6-4c3a-b132-985162af1b52 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.315356 Jan 28 01:59:07.011374 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 184/356] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:06 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:07.015967 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fce54dff-4f2c-467f-a487-8185dcd7f50e"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:07.023681 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:07.046768 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:07.047515 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:07.048457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:07.049109 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:07.180731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:07.217495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:07.219887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:07.222500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0f447948-a0cb-4650-a7a1-9173b1716259 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.445174 Jan 28 01:59:07.238764 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 173/357] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:06 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:07.248407 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] HTTP exception thrown: Invalid volume: volume fce54dff-4f2c-467f-a487-8185dcd7f50e is already attached to instances: 9ae16871-7072-45bc-9498-b2187c59cb1f Jan 28 01:59:07.250766 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Returning 400 to user: Invalid volume: volume fce54dff-4f2c-467f-a487-8185dcd7f50e is already attached to instances: 9ae16871-7072-45bc-9498-b2187c59cb1f {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:07.253852 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cfe14fc5-ab4c-40c5-b780-47eca2b7b4ad tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.239464 Jan 28 01:59:07.254452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 185/358] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 01:59:07 2022] POST /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments => generated 174 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:59:07.376915 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ff0d603f-ecd0-4928-9d63-0522b0c3d7f8 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:07.378106 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ff0d603f-ecd0-4928-9d63-0522b0c3d7f8 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:07.387074 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff0d603f-ecd0-4928-9d63-0522b0c3d7f8 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:07.388875 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff0d603f-ecd0-4928-9d63-0522b0c3d7f8 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:07.390606 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff0d603f-ecd0-4928-9d63-0522b0c3d7f8 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:07.391428 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff0d603f-ecd0-4928-9d63-0522b0c3d7f8 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:07.695142 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-ff0d603f-ecd0-4928-9d63-0522b0c3d7f8 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lazy-loading 'services' on Instance uuid 9ae16871-7072-45bc-9498-b2187c59cb1f {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:59:07.784148 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5ab4e323-f868-435e-b6bf-fa7b47583db8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:07.785356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5ab4e323-f868-435e-b6bf-fa7b47583db8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:07.799180 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ab4e323-f868-435e-b6bf-fa7b47583db8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:07.802746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ab4e323-f868-435e-b6bf-fa7b47583db8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:07.804000 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ab4e323-f868-435e-b6bf-fa7b47583db8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:07.806204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ab4e323-f868-435e-b6bf-fa7b47583db8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:07.906477 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ff0d603f-ecd0-4928-9d63-0522b0c3d7f8 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments/fce54dff-4f2c-467f-a487-8185dcd7f50e" status: 202 len: 0 microversion: 2.1 time: 0.534123 Jan 28 01:59:07.911419 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 174/359] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 01:59:07 2022] DELETE /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments/fce54dff-4f2c-467f-a487-8185dcd7f50e => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:59:07.951614 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3c82492d-8bc2-489f-8210-aeb52ebdfea9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:07.953709 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3c82492d-8bc2-489f-8210-aeb52ebdfea9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:07.970144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c82492d-8bc2-489f-8210-aeb52ebdfea9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:07.970610 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c82492d-8bc2-489f-8210-aeb52ebdfea9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:07.973866 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c82492d-8bc2-489f-8210-aeb52ebdfea9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:07.975676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c82492d-8bc2-489f-8210-aeb52ebdfea9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:08.039100 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5ab4e323-f868-435e-b6bf-fa7b47583db8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:08.049795 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5ab4e323-f868-435e-b6bf-fa7b47583db8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.273313 Jan 28 01:59:08.051468 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 186/360] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:07 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:08.065806 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e50f61b5-0142-4044-8e25-5578ab3e0df8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:08.066784 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e50f61b5-0142-4044-8e25-5578ab3e0df8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:08.068144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3c82492d-8bc2-489f-8210-aeb52ebdfea9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153754 Jan 28 01:59:08.070585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 175/361] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:59:07 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:08.078680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e50f61b5-0142-4044-8e25-5578ab3e0df8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:08.079534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e50f61b5-0142-4044-8e25-5578ab3e0df8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:08.080695 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e50f61b5-0142-4044-8e25-5578ab3e0df8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:08.081793 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e50f61b5-0142-4044-8e25-5578ab3e0df8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:08.252742 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:08.253669 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:08.263945 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:08.264569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:08.269963 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:08.270536 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:08.295745 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e50f61b5-0142-4044-8e25-5578ab3e0df8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:08.303033 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e50f61b5-0142-4044-8e25-5578ab3e0df8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.250272 Jan 28 01:59:08.325798 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 187/362] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:08 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:08.421066 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:08.429100 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:08.430614 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:08.431860 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6ef6d4dc-9557-484f-96ca-255d9950fe7d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.186238 Jan 28 01:59:08.432419 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 176/363] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:08 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:09.068628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8d993cb4-957e-452e-a920-118d99818b32 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:09.069251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8d993cb4-957e-452e-a920-118d99818b32 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:09.075563 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d993cb4-957e-452e-a920-118d99818b32 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.076005 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d993cb4-957e-452e-a920-118d99818b32 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.077772 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d993cb4-957e-452e-a920-118d99818b32 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.078211 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d993cb4-957e-452e-a920-118d99818b32 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.083798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-af708d54-d5d4-44b1-9ce4-9898c254424a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:09.084784 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-af708d54-d5d4-44b1-9ce4-9898c254424a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:09.093403 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-af708d54-d5d4-44b1-9ce4-9898c254424a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.094104 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-af708d54-d5d4-44b1-9ce4-9898c254424a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.094920 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-af708d54-d5d4-44b1-9ce4-9898c254424a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.095516 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-af708d54-d5d4-44b1-9ce4-9898c254424a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.141794 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-af708d54-d5d4-44b1-9ce4-9898c254424a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063377 Jan 28 01:59:09.142967 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 177/364] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:59:09 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:09.232016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8d993cb4-957e-452e-a920-118d99818b32 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:09.240001 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8d993cb4-957e-452e-a920-118d99818b32 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.174967 Jan 28 01:59:09.241089 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 188/365] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:09 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:09.320911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e0b215f4-98b7-467f-8cce-7da5c25dc6e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:09.321796 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e0b215f4-98b7-467f-8cce-7da5c25dc6e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:09.328079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0b215f4-98b7-467f-8cce-7da5c25dc6e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.329071 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0b215f4-98b7-467f-8cce-7da5c25dc6e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.329864 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0b215f4-98b7-467f-8cce-7da5c25dc6e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.330562 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0b215f4-98b7-467f-8cce-7da5c25dc6e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.368975 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1175794820", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:09.426499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] validate_networks() for None {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:59:09.500608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e0b215f4-98b7-467f-8cce-7da5c25dc6e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:09.509451 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e0b215f4-98b7-467f-8cce-7da5c25dc6e7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1502 microversion: 2.1 time: 0.192066 Jan 28 01:59:09.510770 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 178/366] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:09 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:09.515858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:09.516714 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:09.523896 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.524649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.525538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.525976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.805683 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:09.814061 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:09.815853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:09.817246 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f5e4d7f8-dd41-44c9-82b4-03aed6fc621e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.305245 Jan 28 01:59:09.818324 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 179/367] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:09 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:09.822133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:59:09.822773 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:59:09.823395 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a694343-c04f-4ce2-a8c1-1eb877817b0a"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:09.823588 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:59:09.824153 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:59:09.824608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:09.824768 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:59:09.833295 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.833741 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.834727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.835162 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.838631 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.842688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.843276 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.843784 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.862882 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] HTTP exception thrown: Cannot 'attach_volume' instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c while it is in vm_state rescued Jan 28 01:59:09.863065 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Getting quotas for project 703391c3a9b64cf8a323d0fe7e105a6b. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:59:09.863387 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Returning 409 to user: Cannot 'attach_volume' instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c while it is in vm_state rescued {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:09.864223 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-db5f0229-06b3-4a2d-ade1-942a7aa58e12 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044828 Jan 28 01:59:09.864770 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 180/368] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 01:59:09 2022] POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 01:59:09.872878 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Getting quotas for user 838b55acbe1a43538bb82db1e60c4c3c and project 703391c3a9b64cf8a323d0fe7e105a6b. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:59:09.877841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-04f5a416-0b0b-408a-a5f2-0f0410d76a5e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:09.878382 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-04f5a416-0b0b-408a-a5f2-0f0410d76a5e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:09.884493 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04f5a416-0b0b-408a-a5f2-0f0410d76a5e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.884983 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04f5a416-0b0b-408a-a5f2-0f0410d76a5e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.885761 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04f5a416-0b0b-408a-a5f2-0f0410d76a5e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.886367 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04f5a416-0b0b-408a-a5f2-0f0410d76a5e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.891520 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:59:09.894063 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:59:09.949118 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-91e40aa7-6607-4325-a3e0-1dc765d9206e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583638 Jan 28 01:59:09.949757 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 189/369] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:59:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 01:59:09.962837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-632f8ed0-23f0-4b01-9af1-5a3c48e394fb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:09.963455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-632f8ed0-23f0-4b01-9af1-5a3c48e394fb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:09.970407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-04f5a416-0b0b-408a-a5f2-0f0410d76a5e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/action" status: 202 len: 0 microversion: 2.1 time: 0.096138 Jan 28 01:59:09.974796 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 181/370] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 01:59:09 2022] POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:59:09.980927 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b29506cf-8051-4354-9aa3-057d389da1cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:09.981881 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b29506cf-8051-4354-9aa3-057d389da1cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:09.988015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b29506cf-8051-4354-9aa3-057d389da1cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.988532 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b29506cf-8051-4354-9aa3-057d389da1cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:09.989663 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b29506cf-8051-4354-9aa3-057d389da1cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:09.990110 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b29506cf-8051-4354-9aa3-057d389da1cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:10.023630 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-632f8ed0-23f0-4b01-9af1-5a3c48e394fb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:10.030911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-632f8ed0-23f0-4b01-9af1-5a3c48e394fb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1215 microversion: 2.1 time: 0.071853 Jan 28 01:59:10.031544 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 190/371] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:09 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:10.155539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5af45ad2-3e77-456f-ad7b-943093ceebd1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:10.157057 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5af45ad2-3e77-456f-ad7b-943093ceebd1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:10.164350 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b29506cf-8051-4354-9aa3-057d389da1cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:10.165014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5af45ad2-3e77-456f-ad7b-943093ceebd1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:10.165612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5af45ad2-3e77-456f-ad7b-943093ceebd1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:10.166563 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5af45ad2-3e77-456f-ad7b-943093ceebd1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:10.167267 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5af45ad2-3e77-456f-ad7b-943093ceebd1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:10.181650 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b29506cf-8051-4354-9aa3-057d389da1cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1510 microversion: 2.1 time: 0.202767 Jan 28 01:59:10.192197 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 182/372] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:09 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:10.207834 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5af45ad2-3e77-456f-ad7b-943093ceebd1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057312 Jan 28 01:59:10.208447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 191/373] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:59:10 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:59:10.257737 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e8073d7f-fc35-4f04-89e3-99041023052f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:10.258466 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e8073d7f-fc35-4f04-89e3-99041023052f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:10.265553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8073d7f-fc35-4f04-89e3-99041023052f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:10.266112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8073d7f-fc35-4f04-89e3-99041023052f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:10.266970 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8073d7f-fc35-4f04-89e3-99041023052f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:10.267483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8073d7f-fc35-4f04-89e3-99041023052f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:10.409285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-992322299", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "72255c1f-77c9-4e8a-9e7a-3b079454c5f0"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:10.694910 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e8073d7f-fc35-4f04-89e3-99041023052f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:10.707195 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e8073d7f-fc35-4f04-89e3-99041023052f tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.453017 Jan 28 01:59:10.708386 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 183/374] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:10 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:10.841315 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:10.842438 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:10.852384 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:10.853907 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:10.856300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:10.857165 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:11.053878 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:11.062777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:11.064284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:11.065492 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7ddaf010-8abf-4c3f-bcad-2bf02dc3b917 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.230657 Jan 28 01:59:11.066082 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 184/375] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:10 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:11.070323 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-453c3959-5904-4a35-a64f-c9f4ec3b4380 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:11.070931 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-453c3959-5904-4a35-a64f-c9f4ec3b4380 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:11.077253 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-453c3959-5904-4a35-a64f-c9f4ec3b4380 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:11.077709 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-453c3959-5904-4a35-a64f-c9f4ec3b4380 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:11.078490 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-453c3959-5904-4a35-a64f-c9f4ec3b4380 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:11.078930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-453c3959-5904-4a35-a64f-c9f4ec3b4380 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:11.144302 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-453c3959-5904-4a35-a64f-c9f4ec3b4380 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:11.152776 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-453c3959-5904-4a35-a64f-c9f4ec3b4380 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1267 microversion: 2.1 time: 0.085647 Jan 28 01:59:11.153504 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 185/376] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:11 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:11.199602 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-24c822a0-4618-47c7-a735-865248240b87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:11.200719 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-24c822a0-4618-47c7-a735-865248240b87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:11.207925 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24c822a0-4618-47c7-a735-865248240b87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:11.208386 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24c822a0-4618-47c7-a735-865248240b87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:11.209202 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24c822a0-4618-47c7-a735-865248240b87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:11.209642 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24c822a0-4618-47c7-a735-865248240b87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:11.338810 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-24c822a0-4618-47c7-a735-865248240b87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:11.347781 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-24c822a0-4618-47c7-a735-865248240b87 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1510 microversion: 2.1 time: 0.151833 Jan 28 01:59:11.348402 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 186/377] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:11 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:11.724502 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c2290f2e-6c86-40ad-b84c-5b5cf043f243 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:11.725174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c2290f2e-6c86-40ad-b84c-5b5cf043f243 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:11.731407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2290f2e-6c86-40ad-b84c-5b5cf043f243 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:11.732223 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2290f2e-6c86-40ad-b84c-5b5cf043f243 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:11.733063 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2290f2e-6c86-40ad-b84c-5b5cf043f243 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:11.733504 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2290f2e-6c86-40ad-b84c-5b5cf043f243 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:11.943258 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c2290f2e-6c86-40ad-b84c-5b5cf043f243 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:11.954480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c2290f2e-6c86-40ad-b84c-5b5cf043f243 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.233235 Jan 28 01:59:11.955904 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 187/378] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:11 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:12.084368 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:12.085139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:12.092187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.092187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.093064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.093602 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.303479 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:12.312346 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:12.313877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:12.315049 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d5ad0870-5d65-4d11-94b2-9ec510fff901 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.234623 Jan 28 01:59:12.315601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 188/379] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:12 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:12.319827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4719f282-8367-4463-ae07-53b8af98b0ea tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:12.320454 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4719f282-8367-4463-ae07-53b8af98b0ea tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:12.327266 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4719f282-8367-4463-ae07-53b8af98b0ea tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.327717 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4719f282-8367-4463-ae07-53b8af98b0ea tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.328510 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4719f282-8367-4463-ae07-53b8af98b0ea tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.329080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4719f282-8367-4463-ae07-53b8af98b0ea tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.411580 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4719f282-8367-4463-ae07-53b8af98b0ea tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:12.422010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4719f282-8367-4463-ae07-53b8af98b0ea tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1273 microversion: 2.1 time: 0.105001 Jan 28 01:59:12.432666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 189/380] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:12 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:12.432666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-022e6c45-e631-4700-acc8-c52df35a7e9a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:12.432666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-022e6c45-e631-4700-acc8-c52df35a7e9a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:12.439522 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-022e6c45-e631-4700-acc8-c52df35a7e9a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.441364 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-022e6c45-e631-4700-acc8-c52df35a7e9a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.442382 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-022e6c45-e631-4700-acc8-c52df35a7e9a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.442995 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-022e6c45-e631-4700-acc8-c52df35a7e9a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.671679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-022e6c45-e631-4700-acc8-c52df35a7e9a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:12.679730 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-022e6c45-e631-4700-acc8-c52df35a7e9a tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1510 microversion: 2.1 time: 0.255670 Jan 28 01:59:12.680299 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 190/381] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:12 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:12.974407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4ec92ebe-90cd-49cf-8dfa-a9a3aba4a9c0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:12.975219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4ec92ebe-90cd-49cf-8dfa-a9a3aba4a9c0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:12.982239 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ec92ebe-90cd-49cf-8dfa-a9a3aba4a9c0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.982795 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ec92ebe-90cd-49cf-8dfa-a9a3aba4a9c0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:12.983668 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ec92ebe-90cd-49cf-8dfa-a9a3aba4a9c0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:12.984219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ec92ebe-90cd-49cf-8dfa-a9a3aba4a9c0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:13.201521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4ec92ebe-90cd-49cf-8dfa-a9a3aba4a9c0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:13.209105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4ec92ebe-90cd-49cf-8dfa-a9a3aba4a9c0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.238343 Jan 28 01:59:13.209652 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 191/382] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:12 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:13.334176 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:13.338485 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:13.349921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:13.350380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:13.351173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:13.351619 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:13.375205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] validate_networks() for [('72255c1f-77c9-4e8a-9e7a-3b079454c5f0', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:59:13.737099 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:13.749182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:13.750681 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:13.751858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1fabae2d-6a5f-49cb-9c2c-e72b88356554 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.421443 Jan 28 01:59:13.752424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 192/383] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:13 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:13.756833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b032da8b-7951-4b4c-b825-6ec236d75a9e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:13.757448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b032da8b-7951-4b4c-b825-6ec236d75a9e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:13.764532 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b032da8b-7951-4b4c-b825-6ec236d75a9e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:13.765062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b032da8b-7951-4b4c-b825-6ec236d75a9e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:13.765917 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b032da8b-7951-4b4c-b825-6ec236d75a9e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:13.766380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b032da8b-7951-4b4c-b825-6ec236d75a9e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.091213 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b032da8b-7951-4b4c-b825-6ec236d75a9e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:14.109889 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b032da8b-7951-4b4c-b825-6ec236d75a9e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.356338 Jan 28 01:59:14.113135 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 193/384] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:13 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:14.118726 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-90bd137a-950d-4a51-9fce-5ab314fff757 req-3c8f7889-5bc2-406a-ad85-b2f7f22b0108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f935bc-cbcf-4159-ad74-d1edd6058988", "tag": "dc8b2a50-fe3e-4162-a186-494f743036d5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:14.120722 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:14.120722 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:14.147909 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-90bd137a-950d-4a51-9fce-5ab314fff757 req-3c8f7889-5bc2-406a-ad85-b2f7f22b0108 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.148624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-90bd137a-950d-4a51-9fce-5ab314fff757 req-3c8f7889-5bc2-406a-ad85-b2f7f22b0108 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.162500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-90bd137a-950d-4a51-9fce-5ab314fff757 req-3c8f7889-5bc2-406a-ad85-b2f7f22b0108 service nova] Creating event network-changed:dc8b2a50-fe3e-4162-a186-494f743036d5 for instance 09f935bc-cbcf-4159-ad74-d1edd6058988 on hv-cinder-82497 Jan 28 01:59:14.167044 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-90bd137a-950d-4a51-9fce-5ab314fff757 req-3c8f7889-5bc2-406a-ad85-b2f7f22b0108 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052508 Jan 28 01:59:14.169054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 194/385] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:14.174824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b8604670-2d1f-4ec1-966b-ef18f055fa16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:14.175717 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b8604670-2d1f-4ec1-966b-ef18f055fa16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:14.182473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8604670-2d1f-4ec1-966b-ef18f055fa16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.182884 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8604670-2d1f-4ec1-966b-ef18f055fa16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.183674 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8604670-2d1f-4ec1-966b-ef18f055fa16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.184115 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8604670-2d1f-4ec1-966b-ef18f055fa16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.220320 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:59:14.222506 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:59:14.223405 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:59:14.223933 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:59:14.224434 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:59:14.234710 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.235164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.235968 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.236401 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.253520 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Getting quotas for project f2f478fd06754a38b139c8415da6a514. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:59:14.257580 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Getting quotas for user 1f57e62502564821b4be822554d9f5a7 and project f2f478fd06754a38b139c8415da6a514. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:59:14.269653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:59:14.271909 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:59:14.326204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b4cf0096-b96a-4c4d-8577-e7121c3ef256 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.922743 Jan 28 01:59:14.336323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 192/386] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:59:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:59:14.336323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5174f3bd-f348-4349-9f97-b927962aa2f4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:14.336323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5174f3bd-f348-4349-9f97-b927962aa2f4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:14.341595 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5174f3bd-f348-4349-9f97-b927962aa2f4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.342241 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5174f3bd-f348-4349-9f97-b927962aa2f4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.342934 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5174f3bd-f348-4349-9f97-b927962aa2f4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.343379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5174f3bd-f348-4349-9f97-b927962aa2f4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.456261 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b8604670-2d1f-4ec1-966b-ef18f055fa16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:14.469592 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b8604670-2d1f-4ec1-966b-ef18f055fa16 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1516 microversion: 2.1 time: 0.297359 Jan 28 01:59:14.490812 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 195/387] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:14 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1516 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:14.511258 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-37068f2d-4f39-45a8-9ec7-e2723605bfdb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:14.512371 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-37068f2d-4f39-45a8-9ec7-e2723605bfdb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:14.640157 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-37068f2d-4f39-45a8-9ec7-e2723605bfdb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:14.650335 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-37068f2d-4f39-45a8-9ec7-e2723605bfdb tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1217 microversion: 2.1 time: 0.157058 Jan 28 01:59:14.652067 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 196/388] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:14 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:14.690769 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5174f3bd-f348-4349-9f97-b927962aa2f4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:14.705221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5174f3bd-f348-4349-9f97-b927962aa2f4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.377243 Jan 28 01:59:14.706172 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 193/389] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:14 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:14.776190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:14.777347 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:14.786443 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.787231 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.788450 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:14.788938 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:14.995789 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:15.019547 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:15.036896 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:15.038911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-28c5b815-c8b3-4223-9ae3-44de54d1da5e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.269871 Jan 28 01:59:15.044614 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 197/390] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:14 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:15.131561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a8c728f1-40b8-4068-8bf7-0ec95bff27d4 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:15.132297 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a8c728f1-40b8-4068-8bf7-0ec95bff27d4 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:15.139260 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a8c728f1-40b8-4068-8bf7-0ec95bff27d4 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:15.139801 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a8c728f1-40b8-4068-8bf7-0ec95bff27d4 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:15.140683 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a8c728f1-40b8-4068-8bf7-0ec95bff27d4 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:15.141264 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a8c728f1-40b8-4068-8bf7-0ec95bff27d4 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:15.383532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a8c728f1-40b8-4068-8bf7-0ec95bff27d4 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:15.392161 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a8c728f1-40b8-4068-8bf7-0ec95bff27d4 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.266569 Jan 28 01:59:15.392930 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 194/391] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:15 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:15.670829 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8c28d9ba-9efb-45c0-8b65-5876b6ae0a4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:15.671654 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8c28d9ba-9efb-45c0-8b65-5876b6ae0a4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:15.679909 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c28d9ba-9efb-45c0-8b65-5876b6ae0a4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:15.680827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c28d9ba-9efb-45c0-8b65-5876b6ae0a4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:15.681894 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c28d9ba-9efb-45c0-8b65-5876b6ae0a4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:15.682427 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c28d9ba-9efb-45c0-8b65-5876b6ae0a4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:15.732876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cd85d9b4-db78-4647-a260-6387f2930344 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:15.734375 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cd85d9b4-db78-4647-a260-6387f2930344 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:15.742015 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cd85d9b4-db78-4647-a260-6387f2930344 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:15.742593 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cd85d9b4-db78-4647-a260-6387f2930344 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:15.743456 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cd85d9b4-db78-4647-a260-6387f2930344 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:15.743970 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cd85d9b4-db78-4647-a260-6387f2930344 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:15.752756 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8c28d9ba-9efb-45c0-8b65-5876b6ae0a4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:15.760052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8c28d9ba-9efb-45c0-8b65-5876b6ae0a4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1269 microversion: 2.1 time: 0.093669 Jan 28 01:59:15.760624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 198/392] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:15 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:15.877146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cd85d9b4-db78-4647-a260-6387f2930344 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:15.886377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cd85d9b4-db78-4647-a260-6387f2930344 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.158338 Jan 28 01:59:15.887129 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 195/393] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:15 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:16.073013 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:16.073960 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:16.080534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.081391 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.082366 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.082797 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.110992 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ccff62c3-6ddb-4dad-a932-252024240cb7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:16.112306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ccff62c3-6ddb-4dad-a932-252024240cb7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:16.119417 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ccff62c3-6ddb-4dad-a932-252024240cb7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.119943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ccff62c3-6ddb-4dad-a932-252024240cb7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.121429 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ccff62c3-6ddb-4dad-a932-252024240cb7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.123062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ccff62c3-6ddb-4dad-a932-252024240cb7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.650488 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:16.659975 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:16.661465 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:16.662551 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ccff62c3-6ddb-4dad-a932-252024240cb7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:16.662704 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-182fdb21-4364-4ad1-9f60-5e126b0ca4db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.593499 Jan 28 01:59:16.663238 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 199/394] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:16 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:16.668830 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cd7c4f5b-fdcc-4ad5-9601-3de5aadeb943 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:16.674928 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cd7c4f5b-fdcc-4ad5-9601-3de5aadeb943 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:16.681283 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd7c4f5b-fdcc-4ad5-9601-3de5aadeb943 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.681743 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd7c4f5b-fdcc-4ad5-9601-3de5aadeb943 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.682289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ccff62c3-6ddb-4dad-a932-252024240cb7 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1516 microversion: 2.1 time: 0.576970 Jan 28 01:59:16.682529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd7c4f5b-fdcc-4ad5-9601-3de5aadeb943 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.682999 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd7c4f5b-fdcc-4ad5-9601-3de5aadeb943 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.683514 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 196/395] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:16 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1516 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:16.702200 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8d247e9c-10e2-47b9-bc5f-1256343a7fa0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7021390-1659-4780-98cd-2e2bbc521ed8"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:16.703458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8d247e9c-10e2-47b9-bc5f-1256343a7fa0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:16.710685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d247e9c-10e2-47b9-bc5f-1256343a7fa0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.711221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d247e9c-10e2-47b9-bc5f-1256343a7fa0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.712097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d247e9c-10e2-47b9-bc5f-1256343a7fa0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.712619 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d247e9c-10e2-47b9-bc5f-1256343a7fa0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.911481 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cd7c4f5b-fdcc-4ad5-9601-3de5aadeb943 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:16.925160 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cd7c4f5b-fdcc-4ad5-9601-3de5aadeb943 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.260627 Jan 28 01:59:16.925745 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 200/396] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:16 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:16.940098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-db09bb27-2b83-41e4-9b7c-6ec40e8870e5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:16.941032 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-db09bb27-2b83-41e4-9b7c-6ec40e8870e5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:16.946713 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db09bb27-2b83-41e4-9b7c-6ec40e8870e5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.947163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db09bb27-2b83-41e4-9b7c-6ec40e8870e5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:16.947949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db09bb27-2b83-41e4-9b7c-6ec40e8870e5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:16.948390 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db09bb27-2b83-41e4-9b7c-6ec40e8870e5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:17.021555 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8d247e9c-10e2-47b9-bc5f-1256343a7fa0 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323763 Jan 28 01:59:17.022898 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 197/397] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 01:59:16 2022] POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:17.029136 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1b993c53-9f82-4d7b-97ab-d4e38daee48c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:17.029858 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1b993c53-9f82-4d7b-97ab-d4e38daee48c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:17.037605 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b993c53-9f82-4d7b-97ab-d4e38daee48c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:17.038309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b993c53-9f82-4d7b-97ab-d4e38daee48c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:17.039125 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b993c53-9f82-4d7b-97ab-d4e38daee48c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:17.039575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b993c53-9f82-4d7b-97ab-d4e38daee48c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:17.060345 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-db09bb27-2b83-41e4-9b7c-6ec40e8870e5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:17.077848 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-db09bb27-2b83-41e4-9b7c-6ec40e8870e5 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1275 microversion: 2.1 time: 0.141317 Jan 28 01:59:17.078458 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 201/398] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:16 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:17.247076 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1b993c53-9f82-4d7b-97ab-d4e38daee48c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:17.255594 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1b993c53-9f82-4d7b-97ab-d4e38daee48c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.230951 Jan 28 01:59:17.258879 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 198/399] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:17 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:17.688114 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:17.688706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:17.695254 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:17.695707 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:17.696491 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:17.696959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:17.923145 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:17.935377 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:17.938626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:17.940676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3579da23-41f0-4a25-a235-567eecfff108 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.256865 Jan 28 01:59:17.941802 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 202/400] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:17 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:17.946367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c3c77ba-51cb-4559-a905-a7ff699e6be3 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:17.947471 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2c3c77ba-51cb-4559-a905-a7ff699e6be3 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:17.960972 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c3c77ba-51cb-4559-a905-a7ff699e6be3 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:17.961695 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c3c77ba-51cb-4559-a905-a7ff699e6be3 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:17.963272 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c3c77ba-51cb-4559-a905-a7ff699e6be3 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:17.964032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c3c77ba-51cb-4559-a905-a7ff699e6be3 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:18.095663 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-34906089-fc98-4fe1-99fa-b717089ebe4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:18.097120 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-34906089-fc98-4fe1-99fa-b717089ebe4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:18.113075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-34906089-fc98-4fe1-99fa-b717089ebe4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:18.113714 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-34906089-fc98-4fe1-99fa-b717089ebe4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:18.115801 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-34906089-fc98-4fe1-99fa-b717089ebe4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:18.117538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-34906089-fc98-4fe1-99fa-b717089ebe4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:18.247356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c3c77ba-51cb-4559-a905-a7ff699e6be3 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:18.260646 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2c3c77ba-51cb-4559-a905-a7ff699e6be3 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.321267 Jan 28 01:59:18.261680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 199/401] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:17 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:18.267596 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-b62e2432-d7d2-48d4-87f9-b86043cb4e30 req-074d01e2-1466-409e-9d8e-7cefc5330fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b685d7bb-be0f-40cd-817b-38404f317e12", "tag": "795e674c-2378-45d3-a53d-1f3437f0f728"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:18.269566 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:18.269566 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 01:59:18.286846 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-b62e2432-d7d2-48d4-87f9-b86043cb4e30 req-074d01e2-1466-409e-9d8e-7cefc5330fc6 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:18.287288 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-b62e2432-d7d2-48d4-87f9-b86043cb4e30 req-074d01e2-1466-409e-9d8e-7cefc5330fc6 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:18.300769 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-b62e2432-d7d2-48d4-87f9-b86043cb4e30 req-074d01e2-1466-409e-9d8e-7cefc5330fc6 service nova] Creating event network-changed:795e674c-2378-45d3-a53d-1f3437f0f728 for instance b685d7bb-be0f-40cd-817b-38404f317e12 on hv-cinder-82497 Jan 28 01:59:18.307346 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-b62e2432-d7d2-48d4-87f9-b86043cb4e30 req-074d01e2-1466-409e-9d8e-7cefc5330fc6 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043430 Jan 28 01:59:18.308615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 200/402] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:18.314707 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a26fc33f-5e8a-4de3-bebd-5324a576e828 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:18.315418 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a26fc33f-5e8a-4de3-bebd-5324a576e828 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:18.329994 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a26fc33f-5e8a-4de3-bebd-5324a576e828 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:18.330746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a26fc33f-5e8a-4de3-bebd-5324a576e828 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:18.331537 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a26fc33f-5e8a-4de3-bebd-5324a576e828 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:18.332190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a26fc33f-5e8a-4de3-bebd-5324a576e828 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:18.368712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-34906089-fc98-4fe1-99fa-b717089ebe4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:18.379992 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-34906089-fc98-4fe1-99fa-b717089ebe4e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.287955 Jan 28 01:59:18.383666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 203/403] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:18 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:18.570655 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a26fc33f-5e8a-4de3-bebd-5324a576e828 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:18.580458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a26fc33f-5e8a-4de3-bebd-5324a576e828 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.270119 Jan 28 01:59:18.581198 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 201/404] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:18 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:18.959181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:18.959805 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:18.966301 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:18.966807 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:18.967517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:18.968068 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:19.169052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:19.177828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:19.179350 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:19.180550 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a1150145-5fed-4a97-8742-048817fb4bab tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.225106 Jan 28 01:59:19.181533 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 204/405] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:18 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:19.287253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-03e1d819-310a-4a16-bc67-fb7dcfcdc5c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:19.288482 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-03e1d819-310a-4a16-bc67-fb7dcfcdc5c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:19.300251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03e1d819-310a-4a16-bc67-fb7dcfcdc5c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:19.300696 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03e1d819-310a-4a16-bc67-fb7dcfcdc5c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:19.301513 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03e1d819-310a-4a16-bc67-fb7dcfcdc5c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:19.301937 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03e1d819-310a-4a16-bc67-fb7dcfcdc5c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:19.424788 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5b14d3eb-757e-4429-9d59-e841ae118a6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:19.425528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5b14d3eb-757e-4429-9d59-e841ae118a6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:19.432371 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5b14d3eb-757e-4429-9d59-e841ae118a6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:19.432859 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5b14d3eb-757e-4429-9d59-e841ae118a6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:19.433853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5b14d3eb-757e-4429-9d59-e841ae118a6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:19.435127 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5b14d3eb-757e-4429-9d59-e841ae118a6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:19.555952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-03e1d819-310a-4a16-bc67-fb7dcfcdc5c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:19.565821 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-03e1d819-310a-4a16-bc67-fb7dcfcdc5c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.283063 Jan 28 01:59:19.566744 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 202/406] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:19 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:19.598414 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-868bba86-369a-46da-97ba-dd641d12ad4d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:19.599181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-868bba86-369a-46da-97ba-dd641d12ad4d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:19.607816 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-868bba86-369a-46da-97ba-dd641d12ad4d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:19.608336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-868bba86-369a-46da-97ba-dd641d12ad4d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:19.609386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-868bba86-369a-46da-97ba-dd641d12ad4d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:19.610077 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-868bba86-369a-46da-97ba-dd641d12ad4d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:19.717768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5b14d3eb-757e-4429-9d59-e841ae118a6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:19.725254 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5b14d3eb-757e-4429-9d59-e841ae118a6e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.312805 Jan 28 01:59:19.725839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 205/407] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:19 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:19.780161 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-868bba86-369a-46da-97ba-dd641d12ad4d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:19.788302 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-868bba86-369a-46da-97ba-dd641d12ad4d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.194223 Jan 28 01:59:19.788900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 203/408] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:19 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:20.199055 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:20.199699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:20.206161 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:20.206596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:20.207359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:20.207793 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:20.339903 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:20.347933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:20.349500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:20.350678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3186565d-a6d3-4529-af84-4a0299c1a14a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.155425 Jan 28 01:59:20.351232 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 206/409] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:20 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:20.583282 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6f285860-ff63-45f5-88d0-bd30cb5560c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:20.583884 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6f285860-ff63-45f5-88d0-bd30cb5560c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:20.590332 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6f285860-ff63-45f5-88d0-bd30cb5560c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:20.591331 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6f285860-ff63-45f5-88d0-bd30cb5560c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:20.592094 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6f285860-ff63-45f5-88d0-bd30cb5560c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:20.592522 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6f285860-ff63-45f5-88d0-bd30cb5560c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:20.725031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6f285860-ff63-45f5-88d0-bd30cb5560c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:20.733353 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6f285860-ff63-45f5-88d0-bd30cb5560c8 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.153623 Jan 28 01:59:20.733943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 204/410] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:20 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:20.743201 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-16fd09e8-ba50-40b3-b61f-f1257b9717cd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:20.743922 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-16fd09e8-ba50-40b3-b61f-f1257b9717cd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:20.750368 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-16fd09e8-ba50-40b3-b61f-f1257b9717cd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:20.750874 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-16fd09e8-ba50-40b3-b61f-f1257b9717cd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:20.751747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-16fd09e8-ba50-40b3-b61f-f1257b9717cd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:20.752263 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-16fd09e8-ba50-40b3-b61f-f1257b9717cd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:20.807999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cafdf1b7-21f2-4b54-b0e6-ba6df514399c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:20.807999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cafdf1b7-21f2-4b54-b0e6-ba6df514399c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:20.815306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cafdf1b7-21f2-4b54-b0e6-ba6df514399c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:20.816154 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cafdf1b7-21f2-4b54-b0e6-ba6df514399c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:20.817560 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cafdf1b7-21f2-4b54-b0e6-ba6df514399c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:20.818104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cafdf1b7-21f2-4b54-b0e6-ba6df514399c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:20.938277 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-16fd09e8-ba50-40b3-b61f-f1257b9717cd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:20.945776 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-16fd09e8-ba50-40b3-b61f-f1257b9717cd tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.206997 Jan 28 01:59:20.946358 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 207/411] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:20 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:20.995060 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cafdf1b7-21f2-4b54-b0e6-ba6df514399c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:21.004409 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cafdf1b7-21f2-4b54-b0e6-ba6df514399c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.202075 Jan 28 01:59:21.005005 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 205/412] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:20 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:21.372299 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:21.373105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:21.379251 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:21.379566 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:21.380354 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:21.380785 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:21.516908 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:21.525486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:21.527239 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:21.528396 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-08957add-3ed2-4092-9729-0a140b08a378 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.160726 Jan 28 01:59:21.529209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 208/413] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:21 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:21.750727 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b404ab18-14bd-43ef-a687-1e91d324b770 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:21.751371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b404ab18-14bd-43ef-a687-1e91d324b770 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:21.757490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b404ab18-14bd-43ef-a687-1e91d324b770 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:21.758090 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b404ab18-14bd-43ef-a687-1e91d324b770 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:21.758871 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b404ab18-14bd-43ef-a687-1e91d324b770 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:21.759516 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b404ab18-14bd-43ef-a687-1e91d324b770 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:21.910069 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b404ab18-14bd-43ef-a687-1e91d324b770 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:21.917915 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b404ab18-14bd-43ef-a687-1e91d324b770 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.171071 Jan 28 01:59:21.919138 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 206/414] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:21 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:21.963578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-efe5207e-b5d6-4465-b03f-63cbbbc6d887 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:21.964221 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-efe5207e-b5d6-4465-b03f-63cbbbc6d887 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:21.974275 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-efe5207e-b5d6-4465-b03f-63cbbbc6d887 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:21.974275 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-efe5207e-b5d6-4465-b03f-63cbbbc6d887 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:21.975097 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-efe5207e-b5d6-4465-b03f-63cbbbc6d887 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:21.975535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-efe5207e-b5d6-4465-b03f-63cbbbc6d887 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:22.023890 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ed3a5de1-9fe1-4242-b892-7e8f7883f2c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:22.024533 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ed3a5de1-9fe1-4242-b892-7e8f7883f2c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:22.032608 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed3a5de1-9fe1-4242-b892-7e8f7883f2c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:22.033087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed3a5de1-9fe1-4242-b892-7e8f7883f2c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:22.033966 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed3a5de1-9fe1-4242-b892-7e8f7883f2c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:22.034326 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed3a5de1-9fe1-4242-b892-7e8f7883f2c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:22.162403 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-efe5207e-b5d6-4465-b03f-63cbbbc6d887 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:22.175340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-efe5207e-b5d6-4465-b03f-63cbbbc6d887 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.216087 Jan 28 01:59:22.187881 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 209/415] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:21 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:22.218847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ed3a5de1-9fe1-4242-b892-7e8f7883f2c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:22.234181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ed3a5de1-9fe1-4242-b892-7e8f7883f2c6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.216162 Jan 28 01:59:22.245650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 207/416] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:22 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:22.282779 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-4fba4340-aab5-43bc-8693-1b544e732ae1 req-24ea7e49-5852-4ea8-bddd-adeb00b14ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95db6794-9e5c-4a0e-a565-cdf17c8174c5", "name": "network-vif-plugged", "status": "completed", "tag": "a96061fe-84a7-4238-9f60-3ee0a48a23b7"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:22.284561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:22.284561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:22.292118 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-4fba4340-aab5-43bc-8693-1b544e732ae1 req-24ea7e49-5852-4ea8-bddd-adeb00b14ea3 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:22.292558 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-4fba4340-aab5-43bc-8693-1b544e732ae1 req-24ea7e49-5852-4ea8-bddd-adeb00b14ea3 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:22.319714 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-4fba4340-aab5-43bc-8693-1b544e732ae1 req-24ea7e49-5852-4ea8-bddd-adeb00b14ea3 service nova] Creating event network-vif-plugged:a96061fe-84a7-4238-9f60-3ee0a48a23b7 for instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 on hv-cinder-82497 Jan 28 01:59:22.326689 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-4fba4340-aab5-43bc-8693-1b544e732ae1 req-24ea7e49-5852-4ea8-bddd-adeb00b14ea3 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052764 Jan 28 01:59:22.327359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 210/417] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:22.554721 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:22.555602 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:22.563566 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:22.564173 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:22.565306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:22.565700 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:22.774908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:22.784993 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:22.786499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:22.787681 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6bbc853c-28b6-479c-899a-a9ab87230a7b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.244606 Jan 28 01:59:22.788248 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 208/418] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:22 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:22.937911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e046d7ec-fbf3-4bd5-bfbc-39946785be02 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:22.938497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e046d7ec-fbf3-4bd5-bfbc-39946785be02 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:22.944957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e046d7ec-fbf3-4bd5-bfbc-39946785be02 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:22.945408 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e046d7ec-fbf3-4bd5-bfbc-39946785be02 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:22.946192 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e046d7ec-fbf3-4bd5-bfbc-39946785be02 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:22.946646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e046d7ec-fbf3-4bd5-bfbc-39946785be02 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:23.085990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e046d7ec-fbf3-4bd5-bfbc-39946785be02 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:23.094047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e046d7ec-fbf3-4bd5-bfbc-39946785be02 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.160452 Jan 28 01:59:23.094646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 211/419] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:22 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:23.194779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e7d463c6-7e39-4eb7-a739-beba849f2123 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:23.195299 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e7d463c6-7e39-4eb7-a739-beba849f2123 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:23.202515 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7d463c6-7e39-4eb7-a739-beba849f2123 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:23.202958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7d463c6-7e39-4eb7-a739-beba849f2123 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:23.203724 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7d463c6-7e39-4eb7-a739-beba849f2123 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:23.204154 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7d463c6-7e39-4eb7-a739-beba849f2123 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:23.257619 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-411dcef3-645f-47f1-874b-1566cbfa8d44 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:23.258335 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-411dcef3-645f-47f1-874b-1566cbfa8d44 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:23.265505 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-411dcef3-645f-47f1-874b-1566cbfa8d44 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:23.265961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-411dcef3-645f-47f1-874b-1566cbfa8d44 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:23.266745 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-411dcef3-645f-47f1-874b-1566cbfa8d44 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:23.267180 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-411dcef3-645f-47f1-874b-1566cbfa8d44 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:23.368651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e7d463c6-7e39-4eb7-a739-beba849f2123 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:23.379736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e7d463c6-7e39-4eb7-a739-beba849f2123 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.188597 Jan 28 01:59:23.380676 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 209/420] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:23 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:23.429353 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-411dcef3-645f-47f1-874b-1566cbfa8d44 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:23.437587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-411dcef3-645f-47f1-874b-1566cbfa8d44 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.185848 Jan 28 01:59:23.438443 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 212/421] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:23 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:23.807615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:23.808295 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:23.815818 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:23.816265 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:23.817088 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:23.817523 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:23.973615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:23.981524 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:23.983021 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:23.984169 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c7901f19-f513-4bd6-a307-ce67f7804bd9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.180661 Jan 28 01:59:23.984774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 210/422] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:23 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:24.111926 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d52f4e80-6454-4213-8e48-ea9b47e2efa1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:24.112538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d52f4e80-6454-4213-8e48-ea9b47e2efa1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:24.118646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d52f4e80-6454-4213-8e48-ea9b47e2efa1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.119090 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d52f4e80-6454-4213-8e48-ea9b47e2efa1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.119853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d52f4e80-6454-4213-8e48-ea9b47e2efa1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.120281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d52f4e80-6454-4213-8e48-ea9b47e2efa1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.247044 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d52f4e80-6454-4213-8e48-ea9b47e2efa1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:24.254247 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d52f4e80-6454-4213-8e48-ea9b47e2efa1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.146152 Jan 28 01:59:24.254807 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 213/423] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:24 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:24.348893 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-f03b85f2-514f-44ab-9ba6-c9ccf45b6bbd req-445d380f-41cd-430e-a48d-7f65b1b25788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f935bc-cbcf-4159-ad74-d1edd6058988", "name": "network-vif-plugged", "status": "completed", "tag": "dc8b2a50-fe3e-4162-a186-494f743036d5"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:24.350616 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:24.350616 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 01:59:24.359166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f03b85f2-514f-44ab-9ba6-c9ccf45b6bbd req-445d380f-41cd-430e-a48d-7f65b1b25788 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.359607 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f03b85f2-514f-44ab-9ba6-c9ccf45b6bbd req-445d380f-41cd-430e-a48d-7f65b1b25788 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.370628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-f03b85f2-514f-44ab-9ba6-c9ccf45b6bbd req-445d380f-41cd-430e-a48d-7f65b1b25788 service nova] Creating event network-vif-plugged:dc8b2a50-fe3e-4162-a186-494f743036d5 for instance 09f935bc-cbcf-4159-ad74-d1edd6058988 on hv-cinder-82497 Jan 28 01:59:24.375400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-f03b85f2-514f-44ab-9ba6-c9ccf45b6bbd req-445d380f-41cd-430e-a48d-7f65b1b25788 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030553 Jan 28 01:59:24.375984 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 211/424] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:24.398031 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0dd7fa1d-bbd2-44d4-86c5-45ec122e1387 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:24.398665 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0dd7fa1d-bbd2-44d4-86c5-45ec122e1387 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:24.405647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1d-bbd2-44d4-86c5-45ec122e1387 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.406088 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1d-bbd2-44d4-86c5-45ec122e1387 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.406858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1d-bbd2-44d4-86c5-45ec122e1387 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.407289 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1d-bbd2-44d4-86c5-45ec122e1387 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.455675 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fa03db2e-62df-465f-8cd7-583cda38d160 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:24.456459 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fa03db2e-62df-465f-8cd7-583cda38d160 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:24.463273 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa03db2e-62df-465f-8cd7-583cda38d160 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.463719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa03db2e-62df-465f-8cd7-583cda38d160 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.464504 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa03db2e-62df-465f-8cd7-583cda38d160 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:24.465155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa03db2e-62df-465f-8cd7-583cda38d160 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:24.683393 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0dd7fa1d-bbd2-44d4-86c5-45ec122e1387 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:24.691951 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0dd7fa1d-bbd2-44d4-86c5-45ec122e1387 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.297982 Jan 28 01:59:24.692534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 214/425] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:24 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:24.725326 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fa03db2e-62df-465f-8cd7-583cda38d160 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:24.733994 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fa03db2e-62df-465f-8cd7-583cda38d160 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1266 microversion: 2.1 time: 0.282534 Jan 28 01:59:24.734687 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 212/426] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:24 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:25.003137 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:25.003735 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:25.010051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.010498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.011263 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.011694 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.150087 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:25.158677 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:25.160167 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:25.161381 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-aa2dfa44-5409-4fe7-ad3f-982370501480 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.162027 Jan 28 01:59:25.161944 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 215/427] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:24 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:25.272013 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bdb88a6e-2ae7-4e67-b700-4056a9aca045 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:25.272632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bdb88a6e-2ae7-4e67-b700-4056a9aca045 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:25.279513 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bdb88a6e-2ae7-4e67-b700-4056a9aca045 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.279962 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bdb88a6e-2ae7-4e67-b700-4056a9aca045 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.280739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bdb88a6e-2ae7-4e67-b700-4056a9aca045 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.281204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bdb88a6e-2ae7-4e67-b700-4056a9aca045 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.412011 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bdb88a6e-2ae7-4e67-b700-4056a9aca045 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:25.421017 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bdb88a6e-2ae7-4e67-b700-4056a9aca045 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.152476 Jan 28 01:59:25.421734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 213/428] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:25 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:25.712644 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a17e150c-b25c-45a1-bfd4-ed49cf7767e3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:25.713282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a17e150c-b25c-45a1-bfd4-ed49cf7767e3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:25.720094 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a17e150c-b25c-45a1-bfd4-ed49cf7767e3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.720534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a17e150c-b25c-45a1-bfd4-ed49cf7767e3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.721358 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a17e150c-b25c-45a1-bfd4-ed49cf7767e3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.721786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a17e150c-b25c-45a1-bfd4-ed49cf7767e3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.752771 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bc0841f0-fd3b-4d80-bba4-98c82367d134 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:25.753510 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bc0841f0-fd3b-4d80-bba4-98c82367d134 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:25.760216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc0841f0-fd3b-4d80-bba4-98c82367d134 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.760769 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc0841f0-fd3b-4d80-bba4-98c82367d134 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.761648 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc0841f0-fd3b-4d80-bba4-98c82367d134 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.762692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc0841f0-fd3b-4d80-bba4-98c82367d134 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.897748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a17e150c-b25c-45a1-bfd4-ed49cf7767e3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:25.920950 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a17e150c-b25c-45a1-bfd4-ed49cf7767e3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.213289 Jan 28 01:59:25.921726 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 216/429] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:25 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:25.943451 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bc0841f0-fd3b-4d80-bba4-98c82367d134 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:25.952213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bc0841f0-fd3b-4d80-bba4-98c82367d134 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1453 microversion: 2.1 time: 0.204202 Jan 28 01:59:25.953048 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 214/430] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:25 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1453 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:25.970649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5e9107b5-1eae-46a7-a433-dff3c0c0294a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:25.971267 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5e9107b5-1eae-46a7-a433-dff3c0c0294a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:25.977393 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e9107b5-1eae-46a7-a433-dff3c0c0294a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.977844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e9107b5-1eae-46a7-a433-dff3c0c0294a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:25.978632 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e9107b5-1eae-46a7-a433-dff3c0c0294a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:25.979072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e9107b5-1eae-46a7-a433-dff3c0c0294a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:26.123052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5e9107b5-1eae-46a7-a433-dff3c0c0294a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:26.130538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5e9107b5-1eae-46a7-a433-dff3c0c0294a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1453 microversion: 2.1 time: 0.164069 Jan 28 01:59:26.131117 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 217/431] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:25 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:26.179861 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:26.180498 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:26.187734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:26.188238 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:26.189109 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:26.189592 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:26.330367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:26.338903 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:26.341113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:26.343305 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b4d323cf-05de-49e4-b94f-b0f614014079 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.167111 Jan 28 01:59:26.354868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 215/432] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:26 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:26.391628 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-84ec994b-f64f-43bc-9add-c307f5e19283 req-54f57b8f-b406-44cd-9f65-24d1ddd7c81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b685d7bb-be0f-40cd-817b-38404f317e12", "name": "network-vif-plugged", "status": "completed", "tag": "795e674c-2378-45d3-a53d-1f3437f0f728"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:26.393336 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:26.393336 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:26.400877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-84ec994b-f64f-43bc-9add-c307f5e19283 req-54f57b8f-b406-44cd-9f65-24d1ddd7c81d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:26.401328 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-84ec994b-f64f-43bc-9add-c307f5e19283 req-54f57b8f-b406-44cd-9f65-24d1ddd7c81d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:26.414150 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-84ec994b-f64f-43bc-9add-c307f5e19283 req-54f57b8f-b406-44cd-9f65-24d1ddd7c81d service nova] Creating event network-vif-plugged:795e674c-2378-45d3-a53d-1f3437f0f728 for instance b685d7bb-be0f-40cd-817b-38404f317e12 on hv-cinder-82497 Jan 28 01:59:26.421069 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-84ec994b-f64f-43bc-9add-c307f5e19283 req-54f57b8f-b406-44cd-9f65-24d1ddd7c81d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033055 Jan 28 01:59:26.422067 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 218/433] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:26.444086 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a6533f6b-fd87-4512-bcc5-7e42ea71ebca tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:26.445255 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a6533f6b-fd87-4512-bcc5-7e42ea71ebca tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:26.455926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6533f6b-fd87-4512-bcc5-7e42ea71ebca tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:26.456887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6533f6b-fd87-4512-bcc5-7e42ea71ebca tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:26.458555 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6533f6b-fd87-4512-bcc5-7e42ea71ebca tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:26.459257 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6533f6b-fd87-4512-bcc5-7e42ea71ebca tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:26.933449 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a6533f6b-fd87-4512-bcc5-7e42ea71ebca tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:26.946600 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b3c447be-7b10-4e33-a394-6f288cbe40df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:26.948259 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b3c447be-7b10-4e33-a394-6f288cbe40df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:26.951553 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a6533f6b-fd87-4512-bcc5-7e42ea71ebca tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1315 microversion: 2.1 time: 0.513592 Jan 28 01:59:26.957929 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 216/434] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:26 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:26.963147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3c447be-7b10-4e33-a394-6f288cbe40df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:26.964344 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3c447be-7b10-4e33-a394-6f288cbe40df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:26.966482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3c447be-7b10-4e33-a394-6f288cbe40df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:26.967374 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3c447be-7b10-4e33-a394-6f288cbe40df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:27.206905 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b3c447be-7b10-4e33-a394-6f288cbe40df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:27.216648 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b3c447be-7b10-4e33-a394-6f288cbe40df tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.278335 Jan 28 01:59:27.217289 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 219/435] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:26 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:27.363334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:27.363953 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:27.370387 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:27.370911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:27.371789 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:27.372474 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:27.618463 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:27.627102 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:27.628604 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:27.629816 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-188ca8ac-178a-476a-bc4b-4e4ce38efea6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.270773 Jan 28 01:59:27.630758 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 217/436] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:27 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:27.976651 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-57e01dc8-944d-4f37-8922-fd63940b41ba tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:27.977291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-57e01dc8-944d-4f37-8922-fd63940b41ba tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:27.984174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57e01dc8-944d-4f37-8922-fd63940b41ba tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:27.984623 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57e01dc8-944d-4f37-8922-fd63940b41ba tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:27.985431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57e01dc8-944d-4f37-8922-fd63940b41ba tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:27.985871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57e01dc8-944d-4f37-8922-fd63940b41ba tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.219065 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-57e01dc8-944d-4f37-8922-fd63940b41ba tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:28.228064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-57e01dc8-944d-4f37-8922-fd63940b41ba tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1464 microversion: 2.1 time: 0.253950 Jan 28 01:59:28.228064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 220/437] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:27 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1464 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:28.236297 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-74f87ee5-ad0e-44e5-b7cb-6b239c0981d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:28.237350 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-74f87ee5-ad0e-44e5-b7cb-6b239c0981d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:28.247630 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-74f87ee5-ad0e-44e5-b7cb-6b239c0981d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:28.248416 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-74f87ee5-ad0e-44e5-b7cb-6b239c0981d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.249244 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-74f87ee5-ad0e-44e5-b7cb-6b239c0981d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:28.249686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-74f87ee5-ad0e-44e5-b7cb-6b239c0981d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.269305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f4f90a2-f4ba-41fa-8a12-755451981b26 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:28.269814 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f4f90a2-f4ba-41fa-8a12-755451981b26 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:28.278791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f4f90a2-f4ba-41fa-8a12-755451981b26 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:28.279245 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f4f90a2-f4ba-41fa-8a12-755451981b26 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.280262 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f4f90a2-f4ba-41fa-8a12-755451981b26 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:28.280698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f4f90a2-f4ba-41fa-8a12-755451981b26 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.307028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f4f90a2-f4ba-41fa-8a12-755451981b26 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 01:59:28.407120 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2f4f90a2-f4ba-41fa-8a12-755451981b26 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "DELETE /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 204 len: 0 microversion: 2.1 time: 0.141135 Jan 28 01:59:28.407845 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 221/438] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 01:59:28 2022] DELETE /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:59:28.416439 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-32234068-5546-44c9-8313-5f1baea604c9 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:28.417175 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-32234068-5546-44c9-8313-5f1baea604c9 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:28.423951 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32234068-5546-44c9-8313-5f1baea604c9 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:28.424414 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32234068-5546-44c9-8313-5f1baea604c9 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.425287 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32234068-5546-44c9-8313-5f1baea604c9 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:28.425732 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32234068-5546-44c9-8313-5f1baea604c9 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.804426 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-74f87ee5-ad0e-44e5-b7cb-6b239c0981d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:28.814036 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-74f87ee5-ad0e-44e5-b7cb-6b239c0981d9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.584196 Jan 28 01:59:28.814629 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 218/439] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:28 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:28.819216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:28.819613 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:28.826422 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:28.826859 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.827874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:28.828302 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:28.974930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-32234068-5546-44c9-8313-5f1baea604c9 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:28.983353 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-32234068-5546-44c9-8313-5f1baea604c9 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1470 microversion: 2.1 time: 0.570959 Jan 28 01:59:28.984430 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 222/440] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:28 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1470 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:29.092012 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:29.100207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:29.101751 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:29.103102 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a12f2fcc-2280-4c6b-8097-5d775d894fbb tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.287523 Jan 28 01:59:29.103836 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 219/441] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:28 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:29.351100 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-8ff5158f-ca17-415f-8508-3be93d9c16f6 req-38e5c345-de5c-4966-b946-185313eb26ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95db6794-9e5c-4a0e-a565-cdf17c8174c5", "tag": "a96061fe-84a7-4238-9f60-3ee0a48a23b7"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:29.352649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:29.352649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:29.361682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-8ff5158f-ca17-415f-8508-3be93d9c16f6 req-38e5c345-de5c-4966-b946-185313eb26ab service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:29.362301 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-8ff5158f-ca17-415f-8508-3be93d9c16f6 req-38e5c345-de5c-4966-b946-185313eb26ab service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:29.373698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-8ff5158f-ca17-415f-8508-3be93d9c16f6 req-38e5c345-de5c-4966-b946-185313eb26ab service nova] Creating event network-changed:a96061fe-84a7-4238-9f60-3ee0a48a23b7 for instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 on hv-cinder-82497 Jan 28 01:59:29.378456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-8ff5158f-ca17-415f-8508-3be93d9c16f6 req-38e5c345-de5c-4966-b946-185313eb26ab service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031565 Jan 28 01:59:29.379050 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 223/442] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:29.831531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ba13523f-325c-4806-8282-388ec07f8f3a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:29.832170 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ba13523f-325c-4806-8282-388ec07f8f3a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:29.838454 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba13523f-325c-4806-8282-388ec07f8f3a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:29.838900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba13523f-325c-4806-8282-388ec07f8f3a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:29.839715 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba13523f-325c-4806-8282-388ec07f8f3a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:29.840656 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba13523f-325c-4806-8282-388ec07f8f3a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:29.994514 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ba13523f-325c-4806-8282-388ec07f8f3a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:30.003099 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ba13523f-325c-4806-8282-388ec07f8f3a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.175142 Jan 28 01:59:30.004079 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 220/443] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:29 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:30.007334 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b3d9ddd4-821c-49ab-8509-0be8fd562dbb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:30.008868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b3d9ddd4-821c-49ab-8509-0be8fd562dbb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:30.017060 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3d9ddd4-821c-49ab-8509-0be8fd562dbb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:30.017769 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3d9ddd4-821c-49ab-8509-0be8fd562dbb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:30.018959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3d9ddd4-821c-49ab-8509-0be8fd562dbb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:30.019597 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3d9ddd4-821c-49ab-8509-0be8fd562dbb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:30.123634 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:30.124292 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:30.131673 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:30.132410 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:30.133400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:30.133992 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:30.183358 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b3d9ddd4-821c-49ab-8509-0be8fd562dbb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:30.197511 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b3d9ddd4-821c-49ab-8509-0be8fd562dbb tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1470 microversion: 2.1 time: 0.195323 Jan 28 01:59:30.198775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 224/444] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:30 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:30.332075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:30.343744 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:30.345426 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:30.346841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-942d44af-0142-4d3e-bf69-87f9bd8067e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.227960 Jan 28 01:59:30.347477 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 221/445] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:30 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:31.026549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-08c0a9fa-afcb-4eb1-8699-0d49ff52f522 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:31.027582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-08c0a9fa-afcb-4eb1-8699-0d49ff52f522 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:31.034315 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08c0a9fa-afcb-4eb1-8699-0d49ff52f522 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:31.034763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08c0a9fa-afcb-4eb1-8699-0d49ff52f522 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:31.035616 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08c0a9fa-afcb-4eb1-8699-0d49ff52f522 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:31.036060 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08c0a9fa-afcb-4eb1-8699-0d49ff52f522 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:31.195136 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08c0a9fa-afcb-4eb1-8699-0d49ff52f522 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:31.203981 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-08c0a9fa-afcb-4eb1-8699-0d49ff52f522 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1317 microversion: 2.1 time: 0.181122 Jan 28 01:59:31.204585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 225/446] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:31 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:31.221210 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4501475c-2782-41d6-b023-1db7f81f7959 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:31.222868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4501475c-2782-41d6-b023-1db7f81f7959 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:31.232203 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4501475c-2782-41d6-b023-1db7f81f7959 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:31.232864 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4501475c-2782-41d6-b023-1db7f81f7959 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:31.233457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4501475c-2782-41d6-b023-1db7f81f7959 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:31.233899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4501475c-2782-41d6-b023-1db7f81f7959 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:31.367657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:31.369122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:31.380868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:31.381674 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:31.383085 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:31.383857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:31.391454 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4501475c-2782-41d6-b023-1db7f81f7959 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:31.399743 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4501475c-2782-41d6-b023-1db7f81f7959 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1470 microversion: 2.1 time: 0.186293 Jan 28 01:59:31.400447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 222/447] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:31 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:31.540380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:31.549145 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:31.550663 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:31.551901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-db0f324d-07e0-49b5-a47e-f91d7a454992 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.188796 Jan 28 01:59:31.552466 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 226/448] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:31 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:32.226087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-56a53fbd-6e59-43a5-afca-6eafdcfefa0a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:32.227449 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-56a53fbd-6e59-43a5-afca-6eafdcfefa0a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:32.236272 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-56a53fbd-6e59-43a5-afca-6eafdcfefa0a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:32.236723 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-56a53fbd-6e59-43a5-afca-6eafdcfefa0a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:32.237558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-56a53fbd-6e59-43a5-afca-6eafdcfefa0a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:32.238030 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-56a53fbd-6e59-43a5-afca-6eafdcfefa0a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:32.421411 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-17b6dbed-1857-4df4-a14b-070d9bd97b3c tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:32.422798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-17b6dbed-1857-4df4-a14b-070d9bd97b3c tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:32.432292 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-17b6dbed-1857-4df4-a14b-070d9bd97b3c tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:32.433044 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-17b6dbed-1857-4df4-a14b-070d9bd97b3c tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:32.434628 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-17b6dbed-1857-4df4-a14b-070d9bd97b3c tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:32.435194 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-17b6dbed-1857-4df4-a14b-070d9bd97b3c tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:32.556843 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-56a53fbd-6e59-43a5-afca-6eafdcfefa0a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:32.566363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-56a53fbd-6e59-43a5-afca-6eafdcfefa0a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1507 microversion: 2.1 time: 0.346591 Jan 28 01:59:32.568070 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 223/449] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:32 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:32.575391 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:32.576425 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:32.583759 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:32.584136 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:32.585052 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:32.585493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:32.666562 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-17b6dbed-1857-4df4-a14b-070d9bd97b3c tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:32.681218 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-17b6dbed-1857-4df4-a14b-070d9bd97b3c tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1470 microversion: 2.1 time: 0.266002 Jan 28 01:59:32.682487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 227/450] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:32 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:32.739554 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:32.749727 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:32.751452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:32.752907 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e0f37add-b696-4b92-b4f7-29a31a8d43d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.182087 Jan 28 01:59:32.753579 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 224/451] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:32 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:33.407213 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4dab46f5-2281-4658-a361-7ab1d3e59c80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:33.408839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4dab46f5-2281-4658-a361-7ab1d3e59c80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:33.422127 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4dab46f5-2281-4658-a361-7ab1d3e59c80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:33.423137 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4dab46f5-2281-4658-a361-7ab1d3e59c80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:33.424138 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4dab46f5-2281-4658-a361-7ab1d3e59c80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:33.425112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4dab46f5-2281-4658-a361-7ab1d3e59c80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:33.468252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-4dab46f5-2281-4658-a361-7ab1d3e59c80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lazy-loading 'flavor' on Instance uuid d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:59:33.640624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4dab46f5-2281-4658-a361-7ab1d3e59c80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/action" status: 200 len: 32 microversion: 2.1 time: 0.238446 Jan 28 01:59:33.641357 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 228/452] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 01:59:33 2022] POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:59:33.650382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-533971e1-0127-4b5e-bd51-b09cb2885f36 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:33.651223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-533971e1-0127-4b5e-bd51-b09cb2885f36 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:33.658631 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-533971e1-0127-4b5e-bd51-b09cb2885f36 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:33.659082 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-533971e1-0127-4b5e-bd51-b09cb2885f36 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:33.659874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-533971e1-0127-4b5e-bd51-b09cb2885f36 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:33.660309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-533971e1-0127-4b5e-bd51-b09cb2885f36 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:33.710948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-faddf224-ced2-482b-a0db-c8fe82c4bcb6 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:33.712164 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-faddf224-ced2-482b-a0db-c8fe82c4bcb6 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:33.726972 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-faddf224-ced2-482b-a0db-c8fe82c4bcb6 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:33.729134 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-faddf224-ced2-482b-a0db-c8fe82c4bcb6 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:33.730587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-faddf224-ced2-482b-a0db-c8fe82c4bcb6 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:33.731981 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-faddf224-ced2-482b-a0db-c8fe82c4bcb6 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:33.875926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-533971e1-0127-4b5e-bd51-b09cb2885f36 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:33.891653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-533971e1-0127-4b5e-bd51-b09cb2885f36 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.244445 Jan 28 01:59:33.892581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 225/453] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:33 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:33.898779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:33.899632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:33.908064 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:33.908927 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:33.910361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:33.911123 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:34.069473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-faddf224-ced2-482b-a0db-c8fe82c4bcb6 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:34.078605 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-faddf224-ced2-482b-a0db-c8fe82c4bcb6 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1470 microversion: 2.1 time: 0.373849 Jan 28 01:59:34.079185 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 229/454] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:33 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:34.084083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e8d61676-f60c-47ce-bfcc-46c5b4251318 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88745e7d-e9dc-4ff8-b70c-1b0501689b2c"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:34.085524 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e8d61676-f60c-47ce-bfcc-46c5b4251318 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:34.092944 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8d61676-f60c-47ce-bfcc-46c5b4251318 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:34.093503 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8d61676-f60c-47ce-bfcc-46c5b4251318 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:34.094369 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8d61676-f60c-47ce-bfcc-46c5b4251318 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:34.094870 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8d61676-f60c-47ce-bfcc-46c5b4251318 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:34.246161 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:34.254411 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:34.255924 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:34.257113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5b433947-0ab4-4f03-9247-d0f8076d4d80 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1744 microversion: 2.20 time: 0.362868 Jan 28 01:59:34.257666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 226/455] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:33 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1744 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:34.599199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e8d61676-f60c-47ce-bfcc-46c5b4251318 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "POST /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518139 Jan 28 01:59:34.600170 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 230/456] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 01:59:34 2022] POST /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments => generated 194 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:34.920299 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-17550057-99f1-4b30-82d1-3e0302233f30 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:34.921811 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-17550057-99f1-4b30-82d1-3e0302233f30 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:34.932094 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17550057-99f1-4b30-82d1-3e0302233f30 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:34.932943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17550057-99f1-4b30-82d1-3e0302233f30 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:34.935591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17550057-99f1-4b30-82d1-3e0302233f30 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:34.936485 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17550057-99f1-4b30-82d1-3e0302233f30 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:35.100341 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ca5cbd10-a580-49b3-a1cf-7ba47c9594f1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:35.102115 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ca5cbd10-a580-49b3-a1cf-7ba47c9594f1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:35.114765 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca5cbd10-a580-49b3-a1cf-7ba47c9594f1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:35.116128 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca5cbd10-a580-49b3-a1cf-7ba47c9594f1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:35.117352 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca5cbd10-a580-49b3-a1cf-7ba47c9594f1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:35.117919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca5cbd10-a580-49b3-a1cf-7ba47c9594f1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:35.196890 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-17550057-99f1-4b30-82d1-3e0302233f30 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:35.206392 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-17550057-99f1-4b30-82d1-3e0302233f30 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.292397 Jan 28 01:59:35.207353 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 227/457] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:34 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:35.277980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:35.278875 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:35.285943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:35.286691 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:35.287644 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:35.288297 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:35.395290 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ca5cbd10-a580-49b3-a1cf-7ba47c9594f1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:35.406943 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ca5cbd10-a580-49b3-a1cf-7ba47c9594f1 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1470 microversion: 2.1 time: 0.311646 Jan 28 01:59:35.407700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 231/458] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:35 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:35.659563 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-ac52f898-ce82-48b6-834b-a06ad4741487 req-296c9ec8-3a5c-4a79-bd44-a32fc7af1aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f935bc-cbcf-4159-ad74-d1edd6058988", "name": "network-vif-deleted", "tag": "dc8b2a50-fe3e-4162-a186-494f743036d5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:35.662295 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:35.662295 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:35.666428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:35.672778 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ac52f898-ce82-48b6-834b-a06ad4741487 req-296c9ec8-3a5c-4a79-bd44-a32fc7af1aee service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:35.673485 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ac52f898-ce82-48b6-834b-a06ad4741487 req-296c9ec8-3a5c-4a79-bd44-a32fc7af1aee service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:35.678581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:35.679399 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:35.680811 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5dda5ce6-e766-4be0-b24d-d6d973ea61c7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1744 microversion: 2.20 time: 0.407940 Jan 28 01:59:35.681769 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 228/459] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:35 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1744 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:35.687094 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-ac52f898-ce82-48b6-834b-a06ad4741487 req-296c9ec8-3a5c-4a79-bd44-a32fc7af1aee service nova] Creating event network-vif-deleted:dc8b2a50-fe3e-4162-a186-494f743036d5 for instance 09f935bc-cbcf-4159-ad74-d1edd6058988 on hv-cinder-82497 Jan 28 01:59:35.691801 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-ac52f898-ce82-48b6-834b-a06ad4741487 req-296c9ec8-3a5c-4a79-bd44-a32fc7af1aee service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037628 Jan 28 01:59:35.692846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 232/460] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:36.236741 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-10cbfe3e-8c32-4989-b83d-4faa64a89b91 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:36.237436 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-10cbfe3e-8c32-4989-b83d-4faa64a89b91 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:36.243532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10cbfe3e-8c32-4989-b83d-4faa64a89b91 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:36.243980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10cbfe3e-8c32-4989-b83d-4faa64a89b91 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:36.244757 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10cbfe3e-8c32-4989-b83d-4faa64a89b91 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:36.245222 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10cbfe3e-8c32-4989-b83d-4faa64a89b91 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:36.374356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-10cbfe3e-8c32-4989-b83d-4faa64a89b91 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:36.382521 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-10cbfe3e-8c32-4989-b83d-4faa64a89b91 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.150587 Jan 28 01:59:36.383031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 229/461] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:36 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:36.429136 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:36.429847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:36.439108 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:36.439836 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:36.441202 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:36.441828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:36.487098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:36.487826 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:36.488298 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lazy-loading 'fault' on Instance uuid 09f935bc-cbcf-4159-ad74-d1edd6058988 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:59:36.553920 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838b55acbe1a43538bb82db1e60c4c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703391c3a9b64cf8a323d0fe7e105a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:36.565455 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-435c28e8-7940-4906-8824-fc2321786f23 tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 200 len: 1305 microversion: 2.1 time: 0.142807 Jan 28 01:59:36.566889 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 233/462] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:36 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 1305 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:36.700864 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:36.701523 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:36.707736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:36.708191 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:36.709010 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:36.709593 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:36.863472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:36.878661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:36.881793 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:36.884159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c745096f-dd62-4242-8454-85632a95b9f2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1744 microversion: 2.20 time: 0.187578 Jan 28 01:59:36.885359 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 230/463] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:36 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:37.403377 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f1a33713-3b8c-4f49-a92f-0c9768a70ac5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:37.404224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f1a33713-3b8c-4f49-a92f-0c9768a70ac5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:37.410457 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1a33713-3b8c-4f49-a92f-0c9768a70ac5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:37.410910 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1a33713-3b8c-4f49-a92f-0c9768a70ac5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:37.411749 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1a33713-3b8c-4f49-a92f-0c9768a70ac5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:37.412189 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1a33713-3b8c-4f49-a92f-0c9768a70ac5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:37.589318 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:37.590196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] [instance: 09f935bc-cbcf-4159-ad74-d1edd6058988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:37.597462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:37.598176 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:37.599377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:37.599953 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:37.617686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] HTTP exception thrown: Instance 09f935bc-cbcf-4159-ad74-d1edd6058988 could not be found. Jan 28 01:59:37.618284 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] Returning 404 to user: Instance 09f935bc-cbcf-4159-ad74-d1edd6058988 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:37.619292 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bb97278d-b011-4f7f-bf81-806a0bd95e4e tempest-VolumesNegativeTest-1595814630 tempest-VolumesNegativeTest-1595814630-project] 10.222.0.96 "GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988" status: 404 len: 111 microversion: 2.1 time: 0.035520 Jan 28 01:59:37.619838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 231/464] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:37 2022] GET /compute/v2.1/servers/09f935bc-cbcf-4159-ad74-d1edd6058988 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:59:37.663108 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f1a33713-3b8c-4f49-a92f-0c9768a70ac5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:37.682791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f1a33713-3b8c-4f49-a92f-0c9768a70ac5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.283329 Jan 28 01:59:37.684857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 234/465] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:37 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:37.786097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1744462463", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-408487327", "security_groups": [{"name": "tempest-secgroup-smoke-54849223"}], "networks": [{"uuid": "9a36e3d5-651e-44a6-a2b4-a2020f9839b6"}], "block_device_mapping_v2": [{"uuid": "5024ddf4-efb9-4625-96e2-bb1ef9969699", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:37.904844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:37.905477 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:37.916293 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:37.916911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:37.917715 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:37.919618 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:37.930045 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] validate_networks() for [('9a36e3d5-651e-44a6-a2b4-a2020f9839b6', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:59:38.307953 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:38.316949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:38.319020 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:38.319660 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6587e699-02c0-4326-ab10-74823e82aa5f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1744 microversion: 2.20 time: 0.419785 Jan 28 01:59:38.330907 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 235/466] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:37 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1744 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:38.330907 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-ac78103a-8db6-4247-998e-2d4b9f64170c req-140567ea-e849-44f4-ab5a-e74a49e1b7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1879ef-ae58-41eb-9c13-3f9a3988a970", "name": "network-vif-plugged", "status": "completed", "tag": "d9332855-e3dc-42d6-9f2e-2138fd34387d"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:38.330907 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:38.330907 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:38.339267 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ac78103a-8db6-4247-998e-2d4b9f64170c req-140567ea-e849-44f4-ab5a-e74a49e1b7f1 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:38.339719 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ac78103a-8db6-4247-998e-2d4b9f64170c req-140567ea-e849-44f4-ab5a-e74a49e1b7f1 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:38.354112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-ac78103a-8db6-4247-998e-2d4b9f64170c req-140567ea-e849-44f4-ab5a-e74a49e1b7f1 service nova] Creating event network-vif-plugged:d9332855-e3dc-42d6-9f2e-2138fd34387d for instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 on hv-cinder-82497 Jan 28 01:59:38.362028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-ac78103a-8db6-4247-998e-2d4b9f64170c req-140567ea-e849-44f4-ab5a-e74a49e1b7f1 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039579 Jan 28 01:59:38.363081 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 236/467] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:38.507261 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:59:38.507529 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:59:38.507940 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:59:38.508341 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:59:38.509048 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:59:38.520269 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:38.520788 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:38.522158 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:38.522158 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:38.548146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Getting quotas for project 50b9208765264efbb2e25f5ba4896b4a. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:59:38.553651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Getting quotas for user a315151d7ab945cbbbe4c88adc4b7203 and project 50b9208765264efbb2e25f5ba4896b4a. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:59:38.623206 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:59:38.625461 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5024ddf4-efb9-4625-96e2-bb1ef9969699',volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:59:38.704506 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a9c6b9f9-b33e-4c62-9ce8-f2631d6079b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:38.705721 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a9c6b9f9-b33e-4c62-9ce8-f2631d6079b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:38.717569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9c6b9f9-b33e-4c62-9ce8-f2631d6079b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:38.718302 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9c6b9f9-b33e-4c62-9ce8-f2631d6079b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:38.719611 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9c6b9f9-b33e-4c62-9ce8-f2631d6079b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:38.720344 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9c6b9f9-b33e-4c62-9ce8-f2631d6079b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:38.802941 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6ce025ef-4e74-4686-8001-6a933d867f51 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.020832 Jan 28 01:59:38.803825 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 232/468] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:59:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:59:38.818384 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-73e05a1d-d077-439b-9bc5-124f142ab458 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:38.819114 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-73e05a1d-d077-439b-9bc5-124f142ab458 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:38.897274 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-73e05a1d-d077-439b-9bc5-124f142ab458 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:38.910489 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-73e05a1d-d077-439b-9bc5-124f142ab458 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1088 microversion: 2.1 time: 0.096750 Jan 28 01:59:38.911419 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 233/469] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:38 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1088 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:38.950888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a9c6b9f9-b33e-4c62-9ce8-f2631d6079b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:38.966349 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a9c6b9f9-b33e-4c62-9ce8-f2631d6079b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.266630 Jan 28 01:59:38.966889 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 237/470] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:38 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:39.338539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:39.339149 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:39.365224 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:39.365751 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:39.366545 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:39.366977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:39.570455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:39.589613 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:39.593427 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:39.594637 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-75f7fc43-b4e8-40de-96e3-269842b36e25 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.259912 Jan 28 01:59:39.597175 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 234/471] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:39 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:39.936779 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-874e545c-8452-4759-8c74-0cfa37df70b2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:39.937934 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-874e545c-8452-4759-8c74-0cfa37df70b2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:39.947790 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-874e545c-8452-4759-8c74-0cfa37df70b2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:39.948377 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-874e545c-8452-4759-8c74-0cfa37df70b2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:39.949260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-874e545c-8452-4759-8c74-0cfa37df70b2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:39.950438 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-874e545c-8452-4759-8c74-0cfa37df70b2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:39.983466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-db1d3ac4-e3cb-47f1-aecb-aded558ea21d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:39.984283 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-db1d3ac4-e3cb-47f1-aecb-aded558ea21d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:39.992961 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db1d3ac4-e3cb-47f1-aecb-aded558ea21d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:39.993681 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db1d3ac4-e3cb-47f1-aecb-aded558ea21d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:39.994822 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db1d3ac4-e3cb-47f1-aecb-aded558ea21d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:39.995676 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db1d3ac4-e3cb-47f1-aecb-aded558ea21d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:40.041177 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-874e545c-8452-4759-8c74-0cfa37df70b2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:40.050611 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-874e545c-8452-4759-8c74-0cfa37df70b2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1186 microversion: 2.1 time: 0.119913 Jan 28 01:59:40.051408 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 238/472] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:39 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1186 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:40.211007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-db1d3ac4-e3cb-47f1-aecb-aded558ea21d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:40.221818 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-db1d3ac4-e3cb-47f1-aecb-aded558ea21d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.242384 Jan 28 01:59:40.222733 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 235/473] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:39 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:40.615998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:40.617040 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:40.630310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:40.630776 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:40.631574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:40.632019 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:40.934945 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:40.949839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:40.951573 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:40.952888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3a6cb8b2-507d-4379-9913-0ddd08b8e66b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.342351 Jan 28 01:59:40.953494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 239/474] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:40 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:41.075570 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f6896a4b-8bbf-49d5-a45f-56e3f4e76d4f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:41.076788 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f6896a4b-8bbf-49d5-a45f-56e3f4e76d4f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:41.095430 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6896a4b-8bbf-49d5-a45f-56e3f4e76d4f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:41.096070 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6896a4b-8bbf-49d5-a45f-56e3f4e76d4f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:41.097524 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6896a4b-8bbf-49d5-a45f-56e3f4e76d4f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:41.098433 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6896a4b-8bbf-49d5-a45f-56e3f4e76d4f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:41.244126 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8f009562-949d-4dae-83d8-c298d3193ded tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:41.244961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8f009562-949d-4dae-83d8-c298d3193ded tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:41.312179 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8f009562-949d-4dae-83d8-c298d3193ded tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:41.313145 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8f009562-949d-4dae-83d8-c298d3193ded tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:41.314286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8f009562-949d-4dae-83d8-c298d3193ded tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:41.314830 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8f009562-949d-4dae-83d8-c298d3193ded tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:41.369820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f6896a4b-8bbf-49d5-a45f-56e3f4e76d4f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:41.382874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f6896a4b-8bbf-49d5-a45f-56e3f4e76d4f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1204 microversion: 2.1 time: 0.317019 Jan 28 01:59:41.383460 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 236/475] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:41 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1204 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:41.698091 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8f009562-949d-4dae-83d8-c298d3193ded tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:41.715306 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8f009562-949d-4dae-83d8-c298d3193ded tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.474846 Jan 28 01:59:41.733100 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 240/476] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:41 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:41.977160 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:41.977794 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:41.988062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:41.992002 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:41.996874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:41.997777 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:42.400940 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-37ceceab-d104-4bea-ab66-c9bb576b2fd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:42.401700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-37ceceab-d104-4bea-ab66-c9bb576b2fd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:42.424625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-37ceceab-d104-4bea-ab66-c9bb576b2fd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:42.425107 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-37ceceab-d104-4bea-ab66-c9bb576b2fd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:42.425916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-37ceceab-d104-4bea-ab66-c9bb576b2fd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:42.426359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-37ceceab-d104-4bea-ab66-c9bb576b2fd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:42.682617 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:42.702064 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:42.704355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:42.705889 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-52c5323f-39c4-408a-9824-e771156cf569 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.735540 Jan 28 01:59:42.706647 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 237/477] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:41 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:42.754118 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-209bd6e4-0678-4e05-be34-18b0c1c22375 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:42.756143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-209bd6e4-0678-4e05-be34-18b0c1c22375 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:42.767612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-209bd6e4-0678-4e05-be34-18b0c1c22375 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:42.769007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-209bd6e4-0678-4e05-be34-18b0c1c22375 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:42.770690 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-209bd6e4-0678-4e05-be34-18b0c1c22375 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:42.771767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-209bd6e4-0678-4e05-be34-18b0c1c22375 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:42.831469 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-37ceceab-d104-4bea-ab66-c9bb576b2fd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:42.839501 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-37ceceab-d104-4bea-ab66-c9bb576b2fd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1270 microversion: 2.1 time: 0.442169 Jan 28 01:59:42.840608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 241/478] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:42 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1270 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:43.159753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-209bd6e4-0678-4e05-be34-18b0c1c22375 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:43.194023 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-209bd6e4-0678-4e05-be34-18b0c1c22375 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.446499 Jan 28 01:59:43.196683 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 238/479] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:42 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:43.733022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:43.734618 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:43.741321 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:43.742278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:43.743299 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:43.743735 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:43.867357 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c718211b-5f18-412a-a111-8c99f5614918 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:43.870731 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c718211b-5f18-412a-a111-8c99f5614918 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:43.895887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c718211b-5f18-412a-a111-8c99f5614918 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:43.896736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c718211b-5f18-412a-a111-8c99f5614918 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:43.897748 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c718211b-5f18-412a-a111-8c99f5614918 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:43.898357 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c718211b-5f18-412a-a111-8c99f5614918 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:44.264103 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:44.276348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:44.286170 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:44.287420 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-702b5666-ed16-452d-ac97-b6b9e636bced tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.559004 Jan 28 01:59:44.288039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 242/480] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:43 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:44.303443 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-013f03b3-9213-4ac9-886c-d30c88cd9674 req-9f05ee66-453d-4918-8bf2-4426feb87c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a298e144-76c9-46a8-9fd3-10930cffe935", "tag": "1938f369-8c3b-46ca-90e4-040b0e1f5517"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:44.309857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:44.309857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:44.338932 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-013f03b3-9213-4ac9-886c-d30c88cd9674 req-9f05ee66-453d-4918-8bf2-4426feb87c1f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:44.339374 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-013f03b3-9213-4ac9-886c-d30c88cd9674 req-9f05ee66-453d-4918-8bf2-4426feb87c1f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:44.364858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-013f03b3-9213-4ac9-886c-d30c88cd9674 req-9f05ee66-453d-4918-8bf2-4426feb87c1f service nova] Creating event network-changed:1938f369-8c3b-46ca-90e4-040b0e1f5517 for instance a298e144-76c9-46a8-9fd3-10930cffe935 on hv-cinder-82497 Jan 28 01:59:44.371916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-013f03b3-9213-4ac9-886c-d30c88cd9674 req-9f05ee66-453d-4918-8bf2-4426feb87c1f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081942 Jan 28 01:59:44.372522 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 243/481] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:44.384755 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f3f5058b-fafd-4f05-a681-423e9011e376 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:44.397665 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f3f5058b-fafd-4f05-a681-423e9011e376 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:44.421333 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3f5058b-fafd-4f05-a681-423e9011e376 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:44.421788 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3f5058b-fafd-4f05-a681-423e9011e376 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:44.422599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3f5058b-fafd-4f05-a681-423e9011e376 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:44.423039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3f5058b-fafd-4f05-a681-423e9011e376 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:44.486605 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c718211b-5f18-412a-a111-8c99f5614918 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:44.510351 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c718211b-5f18-412a-a111-8c99f5614918 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1270 microversion: 2.1 time: 0.646225 Jan 28 01:59:44.529910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 239/482] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:43 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1270 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:44.849028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f3f5058b-fafd-4f05-a681-423e9011e376 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:44.861804 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f3f5058b-fafd-4f05-a681-423e9011e376 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.480574 Jan 28 01:59:44.862858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 244/483] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:44 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:45.310959 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:45.315540 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:45.345150 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:45.345923 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:45.352686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:45.353756 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:45.535206 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b1331742-a14b-43e3-b8ec-5834bde9a357 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:45.537967 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b1331742-a14b-43e3-b8ec-5834bde9a357 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:45.564737 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1331742-a14b-43e3-b8ec-5834bde9a357 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:45.571323 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1331742-a14b-43e3-b8ec-5834bde9a357 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:45.572863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1331742-a14b-43e3-b8ec-5834bde9a357 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:45.573616 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1331742-a14b-43e3-b8ec-5834bde9a357 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:45.862163 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:45.896143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:45.907014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:45.910754 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-91ec4832-a9fb-4fec-9d44-8e43cd095475 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.606578 Jan 28 01:59:45.933385 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 240/484] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:45 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:45.949075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ac661801-1b45-4b83-83cf-00413efce7cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:45.956923 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ac661801-1b45-4b83-83cf-00413efce7cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:45.986652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac661801-1b45-4b83-83cf-00413efce7cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:45.987029 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac661801-1b45-4b83-83cf-00413efce7cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:45.987897 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac661801-1b45-4b83-83cf-00413efce7cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:45.988438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac661801-1b45-4b83-83cf-00413efce7cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:46.246216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b1331742-a14b-43e3-b8ec-5834bde9a357 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:46.254731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b1331742-a14b-43e3-b8ec-5834bde9a357 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1270 microversion: 2.1 time: 0.727088 Jan 28 01:59:46.255978 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 245/485] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:45 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1270 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:46.461715 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ac661801-1b45-4b83-83cf-00413efce7cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:46.476214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ac661801-1b45-4b83-83cf-00413efce7cf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.540359 Jan 28 01:59:46.478962 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 241/486] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:45 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:46.951274 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:46.952399 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:46.969903 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:46.971659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:46.976505 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:46.977772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:47.275139 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-45a76e64-364b-495a-a65c-669377ed59ca tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:47.276106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-45a76e64-364b-495a-a65c-669377ed59ca tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:47.296690 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-45a76e64-364b-495a-a65c-669377ed59ca tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:47.303875 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-45a76e64-364b-495a-a65c-669377ed59ca tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:47.305791 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-45a76e64-364b-495a-a65c-669377ed59ca tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:47.306737 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-45a76e64-364b-495a-a65c-669377ed59ca tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:47.314305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:47.328922 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:47.331176 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:47.332739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fe15a93c-be36-4232-b5d5-28ae46550306 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.386977 Jan 28 01:59:47.342958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 246/487] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:46 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:47.499858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f9abf1a-ab43-42fe-8119-607d25931970 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:47.500827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f9abf1a-ab43-42fe-8119-607d25931970 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:47.517369 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f9abf1a-ab43-42fe-8119-607d25931970 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:47.518486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f9abf1a-ab43-42fe-8119-607d25931970 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:47.520213 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f9abf1a-ab43-42fe-8119-607d25931970 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:47.521015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f9abf1a-ab43-42fe-8119-607d25931970 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:47.620114 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-45a76e64-364b-495a-a65c-669377ed59ca tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:47.629522 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-45a76e64-364b-495a-a65c-669377ed59ca tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1270 microversion: 2.1 time: 0.361320 Jan 28 01:59:47.630101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 242/488] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:47 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1270 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:47.829906 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f9abf1a-ab43-42fe-8119-607d25931970 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:47.866098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2f9abf1a-ab43-42fe-8119-607d25931970 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.373698 Jan 28 01:59:47.867231 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 247/489] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:47 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:48.367803 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:48.368354 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:48.385761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:48.386737 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:48.388363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:48.389270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:48.656320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-825824040", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "f97ed89c-681e-4768-b1be-7eb9acf480b2"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:48.748320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] validate_networks() for [('f97ed89c-681e-4768-b1be-7eb9acf480b2', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 01:59:48.754722 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:48.780381 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:48.782217 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:48.783441 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b3522d83-ed3d-4016-8bc3-4fe39dbabdf7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.420839 Jan 28 01:59:48.783989 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 243/490] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:48 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:48.797211 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a6126d66-eeaf-4698-9a5e-b344a8d57aeb tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:48.798184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a6126d66-eeaf-4698-9a5e-b344a8d57aeb tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:48.815985 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6126d66-eeaf-4698-9a5e-b344a8d57aeb tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:48.816726 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6126d66-eeaf-4698-9a5e-b344a8d57aeb tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:48.817717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6126d66-eeaf-4698-9a5e-b344a8d57aeb tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:48.818306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6126d66-eeaf-4698-9a5e-b344a8d57aeb tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.034785 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a6126d66-eeaf-4698-9a5e-b344a8d57aeb tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:49.042455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a6126d66-eeaf-4698-9a5e-b344a8d57aeb tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.257227 Jan 28 01:59:49.053289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 244/491] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:48 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:49.058356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5652fa2b-41bd-4c7b-a06a-4a394fccd71e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:49.059627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5652fa2b-41bd-4c7b-a06a-4a394fccd71e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:49.066385 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5652fa2b-41bd-4c7b-a06a-4a394fccd71e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.067150 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5652fa2b-41bd-4c7b-a06a-4a394fccd71e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.068103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5652fa2b-41bd-4c7b-a06a-4a394fccd71e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.068697 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5652fa2b-41bd-4c7b-a06a-4a394fccd71e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.190747 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-5652fa2b-41bd-4c7b-a06a-4a394fccd71e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lazy-loading 'services' on Instance uuid b685d7bb-be0f-40cd-817b-38404f317e12 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:59:49.289701 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5652fa2b-41bd-4c7b-a06a-4a394fccd71e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments/88745e7d-e9dc-4ff8-b70c-1b0501689b2c" status: 202 len: 0 microversion: 2.1 time: 0.234752 Jan 28 01:59:49.290744 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 245/492] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 01:59:49 2022] DELETE /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments/88745e7d-e9dc-4ff8-b70c-1b0501689b2c => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:59:49.296967 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-89350887-e7ed-476e-8850-f65aba83af31 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:49.297935 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-89350887-e7ed-476e-8850-f65aba83af31 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:49.305220 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-89350887-e7ed-476e-8850-f65aba83af31 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.307538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-89350887-e7ed-476e-8850-f65aba83af31 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.310395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-89350887-e7ed-476e-8850-f65aba83af31 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.311215 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-89350887-e7ed-476e-8850-f65aba83af31 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.429736 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:59:49.430170 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:59:49.430652 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:59:49.431051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:59:49.431464 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:59:49.447325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.448045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.449039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.449670 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.486357 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Getting quotas for project cf861e434da344c89d039fa373bd0742. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:59:49.490664 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Getting quotas for user 4208d3afaa374826b47a3716a2e6d7cc and project cf861e434da344c89d039fa373bd0742. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:59:49.509473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:59:49.512534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:59:49.530968 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-89350887-e7ed-476e-8850-f65aba83af31 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:49.543213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-89350887-e7ed-476e-8850-f65aba83af31 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.250921 Jan 28 01:59:49.549707 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 246/493] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:49 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:49.557239 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d1bbba1f-3c12-4b98-bccf-faa3a0e5ed95 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:49.558375 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d1bbba1f-3c12-4b98-bccf-faa3a0e5ed95 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:49.566007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1bbba1f-3c12-4b98-bccf-faa3a0e5ed95 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.566678 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1bbba1f-3c12-4b98-bccf-faa3a0e5ed95 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.567739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1bbba1f-3c12-4b98-bccf-faa3a0e5ed95 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.568510 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1bbba1f-3c12-4b98-bccf-faa3a0e5ed95 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.580037 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0208f57e-a5bf-47d7-91f2-01b4d0931499 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943651 Jan 28 01:59:49.581069 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 248/494] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 01:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:59:49.592111 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5eee35c6-ea73-49e6-b265-7383e392ecf5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:49.592994 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5eee35c6-ea73-49e6-b265-7383e392ecf5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:49.605214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d1bbba1f-3c12-4b98-bccf-faa3a0e5ed95 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053967 Jan 28 01:59:49.606445 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 247/495] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:59:49 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:49.678277 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5eee35c6-ea73-49e6-b265-7383e392ecf5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:49.696449 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5eee35c6-ea73-49e6-b265-7383e392ecf5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1218 microversion: 2.1 time: 0.108687 Jan 28 01:59:49.698093 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 249/496] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:49 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:49.811895 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:49.812666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:49.819389 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.819870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:49.820824 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:49.821338 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.062242 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-61f27b3f-2e0c-4edd-8908-272657a5d5da tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:50.065193 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-61f27b3f-2e0c-4edd-8908-272657a5d5da tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:50.078104 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61f27b3f-2e0c-4edd-8908-272657a5d5da tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:50.079285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:50.081253 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61f27b3f-2e0c-4edd-8908-272657a5d5da tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.083642 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61f27b3f-2e0c-4edd-8908-272657a5d5da tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:50.085302 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61f27b3f-2e0c-4edd-8908-272657a5d5da tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.096266 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:50.102814 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:50.105253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ba2434e7-056f-47b3-8bc3-eafc6a6bf0e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.297357 Jan 28 01:59:50.120868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 248/497] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:49 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:50.315800 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-61f27b3f-2e0c-4edd-8908-272657a5d5da tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:50.325605 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-61f27b3f-2e0c-4edd-8908-272657a5d5da tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.268658 Jan 28 01:59:50.326645 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 250/498] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:50 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:50.573085 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-81e184f8-11d7-4cfe-b453-cc995d1630e8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:50.575235 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-81e184f8-11d7-4cfe-b453-cc995d1630e8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:50.584257 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81e184f8-11d7-4cfe-b453-cc995d1630e8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:50.584738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81e184f8-11d7-4cfe-b453-cc995d1630e8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.586029 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81e184f8-11d7-4cfe-b453-cc995d1630e8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:50.586485 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81e184f8-11d7-4cfe-b453-cc995d1630e8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.618763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d1f5c648-51a9-4c8f-ad0f-8021ca0897a3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:50.620157 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d1f5c648-51a9-4c8f-ad0f-8021ca0897a3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:50.627888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d1f5c648-51a9-4c8f-ad0f-8021ca0897a3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:50.628591 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d1f5c648-51a9-4c8f-ad0f-8021ca0897a3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.631417 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d1f5c648-51a9-4c8f-ad0f-8021ca0897a3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:50.633772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d1f5c648-51a9-4c8f-ad0f-8021ca0897a3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.676937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d1f5c648-51a9-4c8f-ad0f-8021ca0897a3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061919 Jan 28 01:59:50.678312 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 251/499] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:59:50 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:50.727006 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c1fd72fd-1018-4c4d-88ee-0fd500827048 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:50.728432 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c1fd72fd-1018-4c4d-88ee-0fd500827048 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:50.760678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1fd72fd-1018-4c4d-88ee-0fd500827048 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:50.767429 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1fd72fd-1018-4c4d-88ee-0fd500827048 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.770326 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1fd72fd-1018-4c4d-88ee-0fd500827048 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:50.771744 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1fd72fd-1018-4c4d-88ee-0fd500827048 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:50.827505 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-81e184f8-11d7-4cfe-b453-cc995d1630e8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:50.842219 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-81e184f8-11d7-4cfe-b453-cc995d1630e8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.274370 Jan 28 01:59:50.842970 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 249/500] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:50 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:50.870211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c1fd72fd-1018-4c4d-88ee-0fd500827048 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:50.881575 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c1fd72fd-1018-4c4d-88ee-0fd500827048 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1214 microversion: 2.1 time: 0.161402 Jan 28 01:59:50.882411 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 252/501] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:50 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:51.138865 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:51.140060 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:51.148316 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.148915 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.149804 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.150316 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.376875 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9cc39df6-3ede-4ce3-a810-b9618f522775 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:51.377409 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9cc39df6-3ede-4ce3-a810-b9618f522775 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:51.385233 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9cc39df6-3ede-4ce3-a810-b9618f522775 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.385693 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9cc39df6-3ede-4ce3-a810-b9618f522775 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.386595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9cc39df6-3ede-4ce3-a810-b9618f522775 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.388611 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9cc39df6-3ede-4ce3-a810-b9618f522775 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.649491 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:51.661337 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:51.663584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:51.665377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7f352667-f968-4e94-b083-b07f70b7babe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.534830 Jan 28 01:59:51.676975 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 250/502] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:51 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:51.693992 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-40b2647f-7b01-4054-ba27-99cb20e02d55 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:51.696149 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-40b2647f-7b01-4054-ba27-99cb20e02d55 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:51.705781 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9cc39df6-3ede-4ce3-a810-b9618f522775 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:51.707747 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40b2647f-7b01-4054-ba27-99cb20e02d55 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.708839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40b2647f-7b01-4054-ba27-99cb20e02d55 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.710452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40b2647f-7b01-4054-ba27-99cb20e02d55 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.711496 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40b2647f-7b01-4054-ba27-99cb20e02d55 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.734634 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9cc39df6-3ede-4ce3-a810-b9618f522775 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.382322 Jan 28 01:59:51.735610 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 253/503] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:51 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:51.763224 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-40b2647f-7b01-4054-ba27-99cb20e02d55 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076185 Jan 28 01:59:51.763804 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 251/504] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 01:59:51 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:59:51.865021 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2833fc44-6f7d-44d5-9679-fd3c3f0a6655 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:51.866021 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2833fc44-6f7d-44d5-9679-fd3c3f0a6655 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:51.887638 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2833fc44-6f7d-44d5-9679-fd3c3f0a6655 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.888983 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2833fc44-6f7d-44d5-9679-fd3c3f0a6655 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.894363 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2833fc44-6f7d-44d5-9679-fd3c3f0a6655 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.896286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2833fc44-6f7d-44d5-9679-fd3c3f0a6655 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.916721 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fab221a7-68c7-488c-939e-d657ddeaf3e1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:51.924050 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fab221a7-68c7-488c-939e-d657ddeaf3e1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:51.947843 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fab221a7-68c7-488c-939e-d657ddeaf3e1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.950153 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fab221a7-68c7-488c-939e-d657ddeaf3e1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:51.952285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fab221a7-68c7-488c-939e-d657ddeaf3e1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:51.953469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fab221a7-68c7-488c-939e-d657ddeaf3e1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:52.169383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fab221a7-68c7-488c-939e-d657ddeaf3e1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:52.192292 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fab221a7-68c7-488c-939e-d657ddeaf3e1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1278 microversion: 2.1 time: 0.287382 Jan 28 01:59:52.198870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 252/505] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:51 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:52.249618 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2833fc44-6f7d-44d5-9679-fd3c3f0a6655 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:52.271058 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2833fc44-6f7d-44d5-9679-fd3c3f0a6655 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.411845 Jan 28 01:59:52.273558 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 254/506] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:51 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:52.684720 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:52.685668 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:52.693178 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:52.693710 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:52.694794 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:52.695535 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:52.759360 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f0e9591d-52c3-493f-8a70-ffe37a4837a5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:52.760751 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f0e9591d-52c3-493f-8a70-ffe37a4837a5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:52.771340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0e9591d-52c3-493f-8a70-ffe37a4837a5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:52.772335 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0e9591d-52c3-493f-8a70-ffe37a4837a5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:52.773979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0e9591d-52c3-493f-8a70-ffe37a4837a5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:52.774768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0e9591d-52c3-493f-8a70-ffe37a4837a5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:52.953428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:52.961994 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:52.963667 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:52.965158 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5f1c36b2-85e4-4a74-930e-4baa5ad85151 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1739 microversion: 2.20 time: 0.285086 Jan 28 01:59:52.966125 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 253/507] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:52 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:53.017525 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-89b06783-fd1d-4619-aa9c-a9a07530db99 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:53.017953 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-89b06783-fd1d-4619-aa9c-a9a07530db99 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:53.024431 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-89b06783-fd1d-4619-aa9c-a9a07530db99 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:53.025060 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-89b06783-fd1d-4619-aa9c-a9a07530db99 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:53.025746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-89b06783-fd1d-4619-aa9c-a9a07530db99 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:53.026185 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-89b06783-fd1d-4619-aa9c-a9a07530db99 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:53.061565 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-89b06783-fd1d-4619-aa9c-a9a07530db99 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 01:59:53.077820 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f0e9591d-52c3-493f-8a70-ffe37a4837a5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:53.095572 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f0e9591d-52c3-493f-8a70-ffe37a4837a5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.342906 Jan 28 01:59:53.103665 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 255/508] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:52 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:53.213527 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-89b06783-fd1d-4619-aa9c-a9a07530db99 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 204 len: 0 microversion: 2.1 time: 0.199622 Jan 28 01:59:53.219926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 254/509] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 01:59:53 2022] DELETE /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:59:53.229661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9677ef4f-88f8-41f9-8461-70c14d333385 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:53.231570 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9677ef4f-88f8-41f9-8461-70c14d333385 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:53.233314 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3a294c4d-1a87-446c-8133-3b7bfaa12411 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:53.234820 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3a294c4d-1a87-446c-8133-3b7bfaa12411 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:53.241868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9677ef4f-88f8-41f9-8461-70c14d333385 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:53.242463 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9677ef4f-88f8-41f9-8461-70c14d333385 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:53.243521 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9677ef4f-88f8-41f9-8461-70c14d333385 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:53.244192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9677ef4f-88f8-41f9-8461-70c14d333385 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:53.245621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a294c4d-1a87-446c-8133-3b7bfaa12411 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:53.247069 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a294c4d-1a87-446c-8133-3b7bfaa12411 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:53.248762 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a294c4d-1a87-446c-8133-3b7bfaa12411 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:53.249807 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a294c4d-1a87-446c-8133-3b7bfaa12411 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:53.645108 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9677ef4f-88f8-41f9-8461-70c14d333385 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:53.653351 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9677ef4f-88f8-41f9-8461-70c14d333385 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1513 microversion: 2.1 time: 0.430907 Jan 28 01:59:53.653952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 255/510] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:53 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1513 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:53.665104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ec1c9f25-63af-49d2-9287-570fffc9b7de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:53.665104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ec1c9f25-63af-49d2-9287-570fffc9b7de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:53.666378 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3a294c4d-1a87-446c-8133-3b7bfaa12411 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:53.675800 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec1c9f25-63af-49d2-9287-570fffc9b7de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:53.676361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec1c9f25-63af-49d2-9287-570fffc9b7de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:53.677877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3a294c4d-1a87-446c-8133-3b7bfaa12411 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.457544 Jan 28 01:59:53.678103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec1c9f25-63af-49d2-9287-570fffc9b7de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:53.678103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec1c9f25-63af-49d2-9287-570fffc9b7de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:53.690957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 256/511] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:53 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:53.996868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:53.997910 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:54.006114 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.006763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:54.007715 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.008260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:54.039867 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ec1c9f25-63af-49d2-9287-570fffc9b7de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:54.054049 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ec1c9f25-63af-49d2-9287-570fffc9b7de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.398971 Jan 28 01:59:54.054837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 256/512] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:53 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:54.121601 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-931a8d6d-af02-425c-8760-8514ace4d67b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:54.122540 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-931a8d6d-af02-425c-8760-8514ace4d67b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:54.129419 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-931a8d6d-af02-425c-8760-8514ace4d67b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.130006 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-931a8d6d-af02-425c-8760-8514ace4d67b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:54.131309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-931a8d6d-af02-425c-8760-8514ace4d67b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.131936 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-931a8d6d-af02-425c-8760-8514ace4d67b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:54.330990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:54.342975 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:54.345060 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:54.346543 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8a4f10af-7727-4f8f-a95a-a770a47c1bb2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1721 microversion: 2.20 time: 0.354597 Jan 28 01:59:54.347232 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 257/513] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:53 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1721 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:54.423766 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-d97c9ead-a4d5-4fc4-8465-f71f411c0dc1 req-a43f32db-7c02-46f0-9dda-5dd9e2055686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367b6b36-483a-4cc8-b26a-2921068ed175", "tag": "8cd36e81-1c02-4dd4-9de3-3cdce47bb04a"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:54.426988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:54.426988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:54.441045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d97c9ead-a4d5-4fc4-8465-f71f411c0dc1 req-a43f32db-7c02-46f0-9dda-5dd9e2055686 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.441867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d97c9ead-a4d5-4fc4-8465-f71f411c0dc1 req-a43f32db-7c02-46f0-9dda-5dd9e2055686 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:54.464401 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-d97c9ead-a4d5-4fc4-8465-f71f411c0dc1 req-a43f32db-7c02-46f0-9dda-5dd9e2055686 service nova] Creating event network-changed:8cd36e81-1c02-4dd4-9de3-3cdce47bb04a for instance 367b6b36-483a-4cc8-b26a-2921068ed175 on hv-cinder-82497 Jan 28 01:59:54.473846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-d97c9ead-a4d5-4fc4-8465-f71f411c0dc1 req-a43f32db-7c02-46f0-9dda-5dd9e2055686 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058285 Jan 28 01:59:54.474994 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 258/514] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:54.528876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-931a8d6d-af02-425c-8760-8514ace4d67b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:54.554625 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-931a8d6d-af02-425c-8760-8514ace4d67b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.437387 Jan 28 01:59:54.555627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 257/515] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:54 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:54.678940 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-18ca7f86-cb12-43df-8475-704ccd80bd61 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:54.680037 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-18ca7f86-cb12-43df-8475-704ccd80bd61 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:54.687772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-18ca7f86-cb12-43df-8475-704ccd80bd61 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.688336 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-18ca7f86-cb12-43df-8475-704ccd80bd61 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:54.689380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-18ca7f86-cb12-43df-8475-704ccd80bd61 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.689912 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-18ca7f86-cb12-43df-8475-704ccd80bd61 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:54.705622 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-68381a9e-7d46-47ad-bfb6-25655d9c3489 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:54.707097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-68381a9e-7d46-47ad-bfb6-25655d9c3489 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:54.718759 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68381a9e-7d46-47ad-bfb6-25655d9c3489 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.719539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68381a9e-7d46-47ad-bfb6-25655d9c3489 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:54.720943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68381a9e-7d46-47ad-bfb6-25655d9c3489 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:54.721718 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68381a9e-7d46-47ad-bfb6-25655d9c3489 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:55.104888 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-68381a9e-7d46-47ad-bfb6-25655d9c3489 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:55.111980 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-18ca7f86-cb12-43df-8475-704ccd80bd61 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:55.118981 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-68381a9e-7d46-47ad-bfb6-25655d9c3489 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.420887 Jan 28 01:59:55.133246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 258/516] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:54 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:55.133529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-18ca7f86-cb12-43df-8475-704ccd80bd61 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1513 microversion: 2.1 time: 0.446700 Jan 28 01:59:55.133739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cf5d2b46-3785-4759-a1af-4222b023c077 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:55.133739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cf5d2b46-3785-4759-a1af-4222b023c077 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:55.136048 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 259/517] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:54 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:55.145670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cf5d2b46-3785-4759-a1af-4222b023c077 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:55.146709 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cf5d2b46-3785-4759-a1af-4222b023c077 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:55.148143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cf5d2b46-3785-4759-a1af-4222b023c077 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:55.148948 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cf5d2b46-3785-4759-a1af-4222b023c077 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:55.374698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:55.375712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:55.383723 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:55.384408 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:55.385338 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:55.385844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:55.396531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cf5d2b46-3785-4759-a1af-4222b023c077 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:55.408327 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cf5d2b46-3785-4759-a1af-4222b023c077 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.285699 Jan 28 01:59:55.409807 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 259/518] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:55 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:55.568008 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:55.582644 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2e8cde5c-106c-4cc5-8f26-34b3a4f1b2d4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:55.583739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2e8cde5c-106c-4cc5-8f26-34b3a4f1b2d4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:55.586994 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:55.591032 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:55.592947 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7e0c63b8-613b-4e8a-944b-9d40f13df997 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1721 microversion: 2.20 time: 0.223408 Jan 28 01:59:55.593797 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 260/519] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:55 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:55.600259 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e8cde5c-106c-4cc5-8f26-34b3a4f1b2d4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:55.601094 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e8cde5c-106c-4cc5-8f26-34b3a4f1b2d4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:55.602766 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e8cde5c-106c-4cc5-8f26-34b3a4f1b2d4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:55.603801 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e8cde5c-106c-4cc5-8f26-34b3a4f1b2d4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.062517 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2e8cde5c-106c-4cc5-8f26-34b3a4f1b2d4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:56.071249 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2e8cde5c-106c-4cc5-8f26-34b3a4f1b2d4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.495280 Jan 28 01:59:56.072134 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 260/520] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:55 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:56.145464 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f3c2def7-b321-475a-84a5-1a220218b5a3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:56.146483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f3c2def7-b321-475a-84a5-1a220218b5a3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:56.149877 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9e2636f4-07ea-46e1-a629-35ce55dc99c0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:56.150783 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9e2636f4-07ea-46e1-a629-35ce55dc99c0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:56.156633 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3c2def7-b321-475a-84a5-1a220218b5a3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:56.157499 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3c2def7-b321-475a-84a5-1a220218b5a3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.158897 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3c2def7-b321-475a-84a5-1a220218b5a3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:56.159695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3c2def7-b321-475a-84a5-1a220218b5a3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.161085 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e2636f4-07ea-46e1-a629-35ce55dc99c0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:56.161819 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e2636f4-07ea-46e1-a629-35ce55dc99c0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.163106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e2636f4-07ea-46e1-a629-35ce55dc99c0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:56.163836 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e2636f4-07ea-46e1-a629-35ce55dc99c0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.435486 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9e2636f4-07ea-46e1-a629-35ce55dc99c0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:56.436173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f3c2def7-b321-475a-84a5-1a220218b5a3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:56.443952 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f3c2def7-b321-475a-84a5-1a220218b5a3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.303941 Jan 28 01:59:56.444542 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 261/521] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:56 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:56.449796 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e6350244-9703-4221-8819-edca0187611d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:56.450451 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e6350244-9703-4221-8819-edca0187611d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:56.454096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9e2636f4-07ea-46e1-a629-35ce55dc99c0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1513 microversion: 2.1 time: 0.310524 Jan 28 01:59:56.455157 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 261/522] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:56 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:56.458357 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6350244-9703-4221-8819-edca0187611d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:56.459171 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6350244-9703-4221-8819-edca0187611d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.460597 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6350244-9703-4221-8819-edca0187611d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:56.461460 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6350244-9703-4221-8819-edca0187611d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.622102 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:56.622785 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:56.629515 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:56.630131 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.631083 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:56.631598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:56.782000 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e6350244-9703-4221-8819-edca0187611d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:56.791205 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e6350244-9703-4221-8819-edca0187611d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.345510 Jan 28 01:59:56.792513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 262/523] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:56 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:56.879317 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:56.888360 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:56.890213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:56.891616 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-49f2a098-b6c8-45e5-b2c4-2cafc75e0059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1721 microversion: 2.20 time: 0.274011 Jan 28 01:59:56.892287 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 262/524] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:56 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:57.093946 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cab764a3-b239-4a70-bf2e-111aaf713602 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:57.094917 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cab764a3-b239-4a70-bf2e-111aaf713602 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:57.105181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cab764a3-b239-4a70-bf2e-111aaf713602 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.107323 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cab764a3-b239-4a70-bf2e-111aaf713602 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.108197 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cab764a3-b239-4a70-bf2e-111aaf713602 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.108644 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cab764a3-b239-4a70-bf2e-111aaf713602 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.258495 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-7d125319-8145-4560-8b44-df320521eaa9 req-0a141977-f605-4f4a-b5b1-23c51268b324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b685d7bb-be0f-40cd-817b-38404f317e12", "name": "network-vif-deleted", "tag": "795e674c-2378-45d3-a53d-1f3437f0f728"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:57.260782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:57.260782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 01:59:57.269841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-7d125319-8145-4560-8b44-df320521eaa9 req-0a141977-f605-4f4a-b5b1-23c51268b324 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.270631 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-7d125319-8145-4560-8b44-df320521eaa9 req-0a141977-f605-4f4a-b5b1-23c51268b324 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.294373 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-7d125319-8145-4560-8b44-df320521eaa9 req-0a141977-f605-4f4a-b5b1-23c51268b324 service nova] Creating event network-vif-deleted:795e674c-2378-45d3-a53d-1f3437f0f728 for instance b685d7bb-be0f-40cd-817b-38404f317e12 on hv-cinder-82497 Jan 28 01:59:57.305192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-7d125319-8145-4560-8b44-df320521eaa9 req-0a141977-f605-4f4a-b5b1-23c51268b324 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049760 Jan 28 01:59:57.307427 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 263/525] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:57.344118 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cab764a3-b239-4a70-bf2e-111aaf713602 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:57.359136 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cab764a3-b239-4a70-bf2e-111aaf713602 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.272156 Jan 28 01:59:57.360452 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 263/526] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:57 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:57.469919 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-44237e4f-7036-4169-ae08-28d1b719d3a0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:57.471402 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-44237e4f-7036-4169-ae08-28d1b719d3a0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:57.477556 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:57.478788 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:57.484952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-44237e4f-7036-4169-ae08-28d1b719d3a0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.485704 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-44237e4f-7036-4169-ae08-28d1b719d3a0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.486496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.486986 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.487292 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-44237e4f-7036-4169-ae08-28d1b719d3a0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.487850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.488055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-44237e4f-7036-4169-ae08-28d1b719d3a0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.488312 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.525363 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.525914 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.526431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lazy-loading 'fault' on Instance uuid b685d7bb-be0f-40cd-817b-38404f317e12 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 01:59:57.598424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:57.609784 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-029a3e6a-552b-4ce1-b7b9-8bb5eed2bdf3 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 200 len: 1307 microversion: 2.1 time: 0.138309 Jan 28 01:59:57.610980 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 264/527] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:57 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:57.671616 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-44237e4f-7036-4169-ae08-28d1b719d3a0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:57.680012 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-44237e4f-7036-4169-ae08-28d1b719d3a0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.221018 Jan 28 01:59:57.680587 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 264/528] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:57 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:57.811125 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-151e6a99-1e67-4787-9789-342ef3eadefb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:57.812278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-151e6a99-1e67-4787-9789-342ef3eadefb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:57.822888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-151e6a99-1e67-4787-9789-342ef3eadefb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.823708 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-151e6a99-1e67-4787-9789-342ef3eadefb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.825929 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-151e6a99-1e67-4787-9789-342ef3eadefb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.826728 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-151e6a99-1e67-4787-9789-342ef3eadefb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.921738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:57.922472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:57.928832 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.929382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.930253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:57.930767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:57.973482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-151e6a99-1e67-4787-9789-342ef3eadefb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:57.984844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-151e6a99-1e67-4787-9789-342ef3eadefb tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.178816 Jan 28 01:59:57.985801 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 265/529] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:57 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:58.091331 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:58.107854 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:58.110692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:58.112903 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2ee71537-be39-4d9d-8fa5-6ee75f777a02 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1721 microversion: 2.20 time: 0.194987 Jan 28 01:59:58.114153 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 265/530] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:57 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:58.370916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-6db5a710-88db-4064-a754-220f0fef7143 req-ab707117-edee-46a7-8102-56a46f2a7438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1879ef-ae58-41eb-9c13-3f9a3988a970", "name": "network-vif-unplugged", "status": "completed", "tag": "d9332855-e3dc-42d6-9f2e-2138fd34387d"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:58.374745 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:59:58.374745 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 01:59:58.385349 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1c288493-330a-4329-be49-592833f7d028 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:58.387624 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1c288493-330a-4329-be49-592833f7d028 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:58.400925 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c288493-330a-4329-be49-592833f7d028 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:58.403739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c288493-330a-4329-be49-592833f7d028 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:58.404833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-6db5a710-88db-4064-a754-220f0fef7143 req-ab707117-edee-46a7-8102-56a46f2a7438 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:58.405270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c288493-330a-4329-be49-592833f7d028 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:58.405559 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-6db5a710-88db-4064-a754-220f0fef7143 req-ab707117-edee-46a7-8102-56a46f2a7438 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:58.406570 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c288493-330a-4329-be49-592833f7d028 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:58.424740 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-6db5a710-88db-4064-a754-220f0fef7143 req-ab707117-edee-46a7-8102-56a46f2a7438 service nova] Creating event network-vif-unplugged:d9332855-e3dc-42d6-9f2e-2138fd34387d for instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 on hv-cinder-82497 Jan 28 01:59:58.433001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-6db5a710-88db-4064-a754-220f0fef7143 req-ab707117-edee-46a7-8102-56a46f2a7438 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066926 Jan 28 01:59:58.434931 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 266/531] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 01:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:58.594014 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1c288493-330a-4329-be49-592833f7d028 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:58.606891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1c288493-330a-4329-be49-592833f7d028 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.228683 Jan 28 01:59:58.607913 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 266/532] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:58 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:58.628072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:58.628976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: b685d7bb-be0f-40cd-817b-38404f317e12] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:58.635565 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:58.636034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:58.636916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:58.637694 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:58.651229 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] HTTP exception thrown: Instance b685d7bb-be0f-40cd-817b-38404f317e12 could not be found. Jan 28 01:59:58.651855 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Returning 404 to user: Instance b685d7bb-be0f-40cd-817b-38404f317e12 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:58.653481 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-29f3ca54-2e7f-495c-aef8-2849414de68e tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12" status: 404 len: 111 microversion: 2.1 time: 0.029350 Jan 28 01:59:58.654535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 267/533] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:58 2022] GET /compute/v2.1/servers/b685d7bb-be0f-40cd-817b-38404f317e12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:59:58.697728 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7d0bcd4d-c869-480f-83f3-935b9f54ce77 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:58.698330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7d0bcd4d-c869-480f-83f3-935b9f54ce77 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:58.704910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-c869-480f-83f3-935b9f54ce77 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:58.705426 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-c869-480f-83f3-935b9f54ce77 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:58.706534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-c869-480f-83f3-935b9f54ce77 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:58.706999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-c869-480f-83f3-935b9f54ce77 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:58.838997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7d0bcd4d-c869-480f-83f3-935b9f54ce77 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:58.848097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7d0bcd4d-c869-480f-83f3-935b9f54ce77 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.154145 Jan 28 01:59:58.848588 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 267/534] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:58 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:59.007379 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-04e48faf-dd03-4b69-a225-e05a076b192b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:59.008039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-04e48faf-dd03-4b69-a225-e05a076b192b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:59.014895 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04e48faf-dd03-4b69-a225-e05a076b192b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.015356 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04e48faf-dd03-4b69-a225-e05a076b192b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.016250 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04e48faf-dd03-4b69-a225-e05a076b192b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.016697 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04e48faf-dd03-4b69-a225-e05a076b192b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.147579 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:59.149183 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:59.161976 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.162783 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.164231 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.165380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.207308 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-04e48faf-dd03-4b69-a225-e05a076b192b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:59.225133 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-04e48faf-dd03-4b69-a225-e05a076b192b tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.221088 Jan 28 01:59:59.226186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 268/535] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:59 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:59.351330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:59.363955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:59.366938 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:59.369288 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-af84519b-5d50-4eb5-a38c-008359a84515 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1664 microversion: 2.20 time: 0.229243 Jan 28 01:59:59.370363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 268/536] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 01:59:59 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1664 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:59.403304 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d17b9b52-6926-4dd2-b9d6-2ff9233ac9c9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b579a35-bad7-4b0e-aa9c-b47fb5999924"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:59.405325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d17b9b52-6926-4dd2-b9d6-2ff9233ac9c9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:59.415549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d17b9b52-6926-4dd2-b9d6-2ff9233ac9c9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.416322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d17b9b52-6926-4dd2-b9d6-2ff9233ac9c9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.417711 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d17b9b52-6926-4dd2-b9d6-2ff9233ac9c9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.418534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d17b9b52-6926-4dd2-b9d6-2ff9233ac9c9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.628664 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c1e43cb1-d084-4a46-9f41-360915478030 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:59.629991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c1e43cb1-d084-4a46-9f41-360915478030 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:59.640688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c1e43cb1-d084-4a46-9f41-360915478030 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.641755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c1e43cb1-d084-4a46-9f41-360915478030 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.643638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c1e43cb1-d084-4a46-9f41-360915478030 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.644420 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c1e43cb1-d084-4a46-9f41-360915478030 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.754195 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d17b9b52-6926-4dd2-b9d6-2ff9233ac9c9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.358702 Jan 28 01:59:59.755046 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 269/537] 10.222.0.96 () {62 vars in 1363 bytes} [Fri Jan 28 01:59:59 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments => generated 188 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:59:59.830871 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c1e43cb1-d084-4a46-9f41-360915478030 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:59:59.840740 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c1e43cb1-d084-4a46-9f41-360915478030 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.218855 Jan 28 01:59:59.841919 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 269/538] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:59 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:59:59.857788 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-35e8a397-6d0f-43c1-8427-e2fe07e751af tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:59.858431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-35e8a397-6d0f-43c1-8427-e2fe07e751af tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:59.865422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-35e8a397-6d0f-43c1-8427-e2fe07e751af tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.865875 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-35e8a397-6d0f-43c1-8427-e2fe07e751af tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.866660 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-35e8a397-6d0f-43c1-8427-e2fe07e751af tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.866849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-514cf234-2e27-4e34-9190-6ec730b2f452 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:59.867086 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-35e8a397-6d0f-43c1-8427-e2fe07e751af tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.867662 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-514cf234-2e27-4e34-9190-6ec730b2f452 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 01:59:59.876019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-514cf234-2e27-4e34-9190-6ec730b2f452 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.876697 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-514cf234-2e27-4e34-9190-6ec730b2f452 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.877827 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-514cf234-2e27-4e34-9190-6ec730b2f452 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:59:59.878590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-514cf234-2e27-4e34-9190-6ec730b2f452 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:59:59.907778 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-35e8a397-6d0f-43c1-8427-e2fe07e751af tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:00:00.005836 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-35e8a397-6d0f-43c1-8427-e2fe07e751af tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 204 len: 0 microversion: 2.1 time: 0.152081 Jan 28 02:00:00.007271 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 270/539] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 01:59:59 2022] DELETE /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:00:00.018274 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f75f3270-0737-4918-bed6-51cac26cf673 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:00.019101 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f75f3270-0737-4918-bed6-51cac26cf673 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:00.025706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f75f3270-0737-4918-bed6-51cac26cf673 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.026197 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f75f3270-0737-4918-bed6-51cac26cf673 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.026994 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f75f3270-0737-4918-bed6-51cac26cf673 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.028168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f75f3270-0737-4918-bed6-51cac26cf673 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.042877 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-514cf234-2e27-4e34-9190-6ec730b2f452 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:00.054229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-514cf234-2e27-4e34-9190-6ec730b2f452 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.192309 Jan 28 02:00:00.054777 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 270/540] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 01:59:59 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:00.059879 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7d3aabb7-c633-4059-9f59-3605a8c1761d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:00.060862 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7d3aabb7-c633-4059-9f59-3605a8c1761d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:00.066900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d3aabb7-c633-4059-9f59-3605a8c1761d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.067346 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d3aabb7-c633-4059-9f59-3605a8c1761d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.068125 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d3aabb7-c633-4059-9f59-3605a8c1761d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.068563 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d3aabb7-c633-4059-9f59-3605a8c1761d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.150743 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f75f3270-0737-4918-bed6-51cac26cf673 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action" status: 202 len: 0 microversion: 2.20 time: 0.140033 Jan 28 02:00:00.151927 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 271/541] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:00:00 2022] POST /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:00:00.166041 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:00.166973 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:00.179627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.180525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.182204 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.183222 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.236478 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7d3aabb7-c633-4059-9f59-3605a8c1761d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:00.245332 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7d3aabb7-c633-4059-9f59-3605a8c1761d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1515 microversion: 2.1 time: 0.189231 Jan 28 02:00:00.255870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 271/542] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:00 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:00.260847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b75c17c6-e4a4-4d7a-96b7-ea3aef82ed75 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:00.262166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b75c17c6-e4a4-4d7a-96b7-ea3aef82ed75 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:00.269406 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b75c17c6-e4a4-4d7a-96b7-ea3aef82ed75 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.270657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b75c17c6-e4a4-4d7a-96b7-ea3aef82ed75 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.270657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b75c17c6-e4a4-4d7a-96b7-ea3aef82ed75 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.271086 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b75c17c6-e4a4-4d7a-96b7-ea3aef82ed75 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.454202 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:00.464047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:00.466074 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:00.467651 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-db59cd71-b25f-463d-9b43-bca91d117047 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1750 microversion: 2.20 time: 0.308454 Jan 28 02:00:00.468594 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 272/543] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:00 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1750 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:00.486625 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b75c17c6-e4a4-4d7a-96b7-ea3aef82ed75 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:00.495581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b75c17c6-e4a4-4d7a-96b7-ea3aef82ed75 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.238480 Jan 28 02:00:00.501588 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 272/544] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:00 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:00.857919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bec3c3c6-2e3d-4832-ac2d-5e39b6582cf4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:00.858540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bec3c3c6-2e3d-4832-ac2d-5e39b6582cf4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:00.864526 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bec3c3c6-2e3d-4832-ac2d-5e39b6582cf4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.865021 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bec3c3c6-2e3d-4832-ac2d-5e39b6582cf4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.865813 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bec3c3c6-2e3d-4832-ac2d-5e39b6582cf4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:00.866246 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bec3c3c6-2e3d-4832-ac2d-5e39b6582cf4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:00.995069 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bec3c3c6-2e3d-4832-ac2d-5e39b6582cf4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:01.004027 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bec3c3c6-2e3d-4832-ac2d-5e39b6582cf4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.149809 Jan 28 02:00:01.004611 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 273/545] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:00 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:01.076524 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9d7f8e5b-42b1-4db4-84d8-fdee2b2420c7 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:01.077312 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9d7f8e5b-42b1-4db4-84d8-fdee2b2420c7 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:01.084580 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9d7f8e5b-42b1-4db4-84d8-fdee2b2420c7 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:01.085328 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9d7f8e5b-42b1-4db4-84d8-fdee2b2420c7 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:01.086134 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9d7f8e5b-42b1-4db4-84d8-fdee2b2420c7 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:01.086674 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9d7f8e5b-42b1-4db4-84d8-fdee2b2420c7 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:01.220187 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9d7f8e5b-42b1-4db4-84d8-fdee2b2420c7 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:01.228833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9d7f8e5b-42b1-4db4-84d8-fdee2b2420c7 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.156186 Jan 28 02:00:01.229444 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 273/546] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:01 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:01.263269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7412944d-8cda-48d7-9da3-5aa21f5dec07 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:01.263869 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7412944d-8cda-48d7-9da3-5aa21f5dec07 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:01.269823 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7412944d-8cda-48d7-9da3-5aa21f5dec07 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:01.270286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7412944d-8cda-48d7-9da3-5aa21f5dec07 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:01.271042 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7412944d-8cda-48d7-9da3-5aa21f5dec07 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:01.272113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7412944d-8cda-48d7-9da3-5aa21f5dec07 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:01.432099 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7412944d-8cda-48d7-9da3-5aa21f5dec07 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:01.440298 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7412944d-8cda-48d7-9da3-5aa21f5dec07 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1515 microversion: 2.1 time: 0.181197 Jan 28 02:00:01.440900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 274/547] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:01 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:01.487532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:01.488147 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:01.494121 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:01.494567 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:01.497403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:01.497403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:01.514270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-58bbbbe3-3be3-4330-b70d-da484c737e0d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:01.515056 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-58bbbbe3-3be3-4330-b70d-da484c737e0d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:01.522296 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58bbbbe3-3be3-4330-b70d-da484c737e0d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:01.522756 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58bbbbe3-3be3-4330-b70d-da484c737e0d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:01.523547 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58bbbbe3-3be3-4330-b70d-da484c737e0d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:01.523984 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58bbbbe3-3be3-4330-b70d-da484c737e0d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:01.715614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:01.724125 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-58bbbbe3-3be3-4330-b70d-da484c737e0d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:01.724991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:01.726612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:01.727907 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b791483f-1051-4df5-9eae-a419aa57c148 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1752 microversion: 2.20 time: 0.244661 Jan 28 02:00:01.728558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 274/548] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:01 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:01.738924 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-58bbbbe3-3be3-4330-b70d-da484c737e0d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.228242 Jan 28 02:00:01.739860 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 275/549] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:01 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:02.022877 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-986c09ba-2ed9-4344-887e-f05e36e58cce tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:02.023406 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-986c09ba-2ed9-4344-887e-f05e36e58cce tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:02.032655 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-986c09ba-2ed9-4344-887e-f05e36e58cce tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.033515 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-986c09ba-2ed9-4344-887e-f05e36e58cce tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.034903 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-986c09ba-2ed9-4344-887e-f05e36e58cce tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.035694 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-986c09ba-2ed9-4344-887e-f05e36e58cce tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.216539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-986c09ba-2ed9-4344-887e-f05e36e58cce tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:02.224553 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-986c09ba-2ed9-4344-887e-f05e36e58cce tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.205427 Jan 28 02:00:02.225199 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 275/550] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:02 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:02.245806 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4ae44abe-8ba7-4a0f-9905-1f8f7c6746bc tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:02.246578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4ae44abe-8ba7-4a0f-9905-1f8f7c6746bc tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:02.253626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ae44abe-8ba7-4a0f-9905-1f8f7c6746bc tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.254092 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ae44abe-8ba7-4a0f-9905-1f8f7c6746bc tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.254880 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ae44abe-8ba7-4a0f-9905-1f8f7c6746bc tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.255513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4ae44abe-8ba7-4a0f-9905-1f8f7c6746bc tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.385874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-c4507097-369a-40bc-9524-eaf66a057c5f req-57405258-03e1-4ad7-8b69-0dd89e159008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a298e144-76c9-46a8-9fd3-10930cffe935", "name": "network-vif-plugged", "status": "completed", "tag": "1938f369-8c3b-46ca-90e4-040b0e1f5517"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:02.388050 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:02.388050 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:00:02.395570 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c4507097-369a-40bc-9524-eaf66a057c5f req-57405258-03e1-4ad7-8b69-0dd89e159008 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.395931 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c4507097-369a-40bc-9524-eaf66a057c5f req-57405258-03e1-4ad7-8b69-0dd89e159008 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.410686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-c4507097-369a-40bc-9524-eaf66a057c5f req-57405258-03e1-4ad7-8b69-0dd89e159008 service nova] Creating event network-vif-plugged:1938f369-8c3b-46ca-90e4-040b0e1f5517 for instance a298e144-76c9-46a8-9fd3-10930cffe935 on hv-cinder-82497 Jan 28 02:00:02.416333 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-c4507097-369a-40bc-9524-eaf66a057c5f req-57405258-03e1-4ad7-8b69-0dd89e159008 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034119 Jan 28 02:00:02.416980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 276/551] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:02.447507 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4ae44abe-8ba7-4a0f-9905-1f8f7c6746bc tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:02.457406 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4ae44abe-8ba7-4a0f-9905-1f8f7c6746bc tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.215352 Jan 28 02:00:02.457988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 276/552] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:02 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:02.467714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2ef58c84-1c00-4a89-964d-c9d883fe8510 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:02.467714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2ef58c84-1c00-4a89-964d-c9d883fe8510 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:02.470890 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ef58c84-1c00-4a89-964d-c9d883fe8510 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.471510 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ef58c84-1c00-4a89-964d-c9d883fe8510 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.472658 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ef58c84-1c00-4a89-964d-c9d883fe8510 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.473246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ef58c84-1c00-4a89-964d-c9d883fe8510 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.730203 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2ef58c84-1c00-4a89-964d-c9d883fe8510 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:02.742092 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2ef58c84-1c00-4a89-964d-c9d883fe8510 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1515 microversion: 2.1 time: 0.285872 Jan 28 02:00:02.743457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 277/553] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:02 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:02.755080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:02.755080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:02.765763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.766900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.768280 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-69622d54-593c-40e4-a393-71006b847e06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:02.768998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.769423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-69622d54-593c-40e4-a393-71006b847e06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:02.770370 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.779693 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-69622d54-593c-40e4-a393-71006b847e06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.780460 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-69622d54-593c-40e4-a393-71006b847e06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:02.782161 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-69622d54-593c-40e4-a393-71006b847e06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:02.783165 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-69622d54-593c-40e4-a393-71006b847e06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.223453 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-69622d54-593c-40e4-a393-71006b847e06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:03.233300 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-69622d54-593c-40e4-a393-71006b847e06 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.472113 Jan 28 02:00:03.234385 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 278/554] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:02 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:03.240303 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:03.252519 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-da779bf0-0e28-499c-b61a-2a842b85a50b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:03.253438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-da779bf0-0e28-499c-b61a-2a842b85a50b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:03.258072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:03.260977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da779bf0-0e28-499c-b61a-2a842b85a50b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:03.262127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da779bf0-0e28-499c-b61a-2a842b85a50b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.262513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:03.263131 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da779bf0-0e28-499c-b61a-2a842b85a50b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:03.263849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da779bf0-0e28-499c-b61a-2a842b85a50b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.264769 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6869ca81-214b-47ca-9484-39a2f497231b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.520352 Jan 28 02:00:03.265849 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 277/555] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:02 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:00:03.480022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-390fae17-0c94-46b3-b232-9d59a7a354c1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:03.482332 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-390fae17-0c94-46b3-b232-9d59a7a354c1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:03.493173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-390fae17-0c94-46b3-b232-9d59a7a354c1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:03.494113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-390fae17-0c94-46b3-b232-9d59a7a354c1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.495878 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-390fae17-0c94-46b3-b232-9d59a7a354c1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:03.497348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-390fae17-0c94-46b3-b232-9d59a7a354c1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.549270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-da779bf0-0e28-499c-b61a-2a842b85a50b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:03.571380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-da779bf0-0e28-499c-b61a-2a842b85a50b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1258 microversion: 2.1 time: 0.323276 Jan 28 02:00:03.575260 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 279/556] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:03 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1258 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:03.589251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-cb0fa73a-7158-4439-85b3-f22b6f6324cd req-2e28782e-5ac8-45e7-a3e9-2169415943f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae16871-7072-45bc-9498-b2187c59cb1f", "name": "network-vif-deleted", "tag": "2d4ca6b9-07ff-4d2f-a74f-39ee5aa53643"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:03.597009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:03.597009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:00:03.611424 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-cb0fa73a-7158-4439-85b3-f22b6f6324cd req-2e28782e-5ac8-45e7-a3e9-2169415943f3 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:03.611887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-cb0fa73a-7158-4439-85b3-f22b6f6324cd req-2e28782e-5ac8-45e7-a3e9-2169415943f3 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.624382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-cb0fa73a-7158-4439-85b3-f22b6f6324cd req-2e28782e-5ac8-45e7-a3e9-2169415943f3 service nova] Creating event network-vif-deleted:2d4ca6b9-07ff-4d2f-a74f-39ee5aa53643 for instance 9ae16871-7072-45bc-9498-b2187c59cb1f on hv-cinder-82497 Jan 28 02:00:03.629493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-cb0fa73a-7158-4439-85b3-f22b6f6324cd req-2e28782e-5ac8-45e7-a3e9-2169415943f3 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052240 Jan 28 02:00:03.630073 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 280/557] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:03.765340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-390fae17-0c94-46b3-b232-9d59a7a354c1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:03.768304 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:03.770503 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:03.784934 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-390fae17-0c94-46b3-b232-9d59a7a354c1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.311304 Jan 28 02:00:03.787496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 278/558] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:03 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:03.788282 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:03.788981 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.789877 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:03.790523 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.840331 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:03.841155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:03.841780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lazy-loading 'fault' on Instance uuid 9ae16871-7072-45bc-9498-b2187c59cb1f {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:00:03.916153 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:03.923774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-17a2a55c-e743-4409-8b24-71d7de77f5a1 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 200 len: 1308 microversion: 2.1 time: 0.163584 Jan 28 02:00:03.924360 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 281/559] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:03 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:04.258284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c9206e3a-f568-41b1-9e77-1dc7f8839bc2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:04.259942 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c9206e3a-f568-41b1-9e77-1dc7f8839bc2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:04.271599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c9206e3a-f568-41b1-9e77-1dc7f8839bc2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.272841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c9206e3a-f568-41b1-9e77-1dc7f8839bc2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:04.274658 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c9206e3a-f568-41b1-9e77-1dc7f8839bc2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.275680 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c9206e3a-f568-41b1-9e77-1dc7f8839bc2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:04.292394 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:04.297482 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:04.319793 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.327734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:04.329590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.330582 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:04.840047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c9206e3a-f568-41b1-9e77-1dc7f8839bc2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:04.850824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c9206e3a-f568-41b1-9e77-1dc7f8839bc2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.600326 Jan 28 02:00:04.852248 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 279/560] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:04 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:04.862362 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:04.864276 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f44864bf-61af-45f8-bd56-d3e971d12a03 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:04.865143 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f44864bf-61af-45f8-bd56-d3e971d12a03 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:04.876825 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f44864bf-61af-45f8-bd56-d3e971d12a03 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.877978 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f44864bf-61af-45f8-bd56-d3e971d12a03 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:04.879330 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f44864bf-61af-45f8-bd56-d3e971d12a03 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.880319 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f44864bf-61af-45f8-bd56-d3e971d12a03 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:04.883253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:04.887977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:04.889485 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fcca7572-3452-4311-bccc-a06279784856 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.604266 Jan 28 02:00:04.891188 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 282/561] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:04 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:04.900153 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-c1a6c505-5b32-40dc-a131-588a213c5684 req-87c965f1-f87c-40f0-a5cf-9243a104132e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367b6b36-483a-4cc8-b26a-2921068ed175", "name": "network-vif-plugged", "status": "completed", "tag": "8cd36e81-1c02-4dd4-9de3-3cdce47bb04a"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:04.903363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:04.903363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:00:04.923546 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c1a6c505-5b32-40dc-a131-588a213c5684 req-87c965f1-f87c-40f0-a5cf-9243a104132e service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.924319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c1a6c505-5b32-40dc-a131-588a213c5684 req-87c965f1-f87c-40f0-a5cf-9243a104132e service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:04.938908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-c1a6c505-5b32-40dc-a131-588a213c5684 req-87c965f1-f87c-40f0-a5cf-9243a104132e service nova] Creating event network-vif-plugged:8cd36e81-1c02-4dd4-9de3-3cdce47bb04a for instance 367b6b36-483a-4cc8-b26a-2921068ed175 on hv-cinder-82497 Jan 28 02:00:04.945498 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-c1a6c505-5b32-40dc-a131-588a213c5684 req-87c965f1-f87c-40f0-a5cf-9243a104132e service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051986 Jan 28 02:00:04.946379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 283/562] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:04.957971 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2b6b2791-04f8-4ff6-869a-4774adc070c0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:04.959242 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2b6b2791-04f8-4ff6-869a-4774adc070c0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:04.970081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2b6b2791-04f8-4ff6-869a-4774adc070c0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.970973 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2b6b2791-04f8-4ff6-869a-4774adc070c0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:04.972493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2b6b2791-04f8-4ff6-869a-4774adc070c0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:04.973393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2b6b2791-04f8-4ff6-869a-4774adc070c0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.156042 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f44864bf-61af-45f8-bd56-d3e971d12a03 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:05.169543 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f44864bf-61af-45f8-bd56-d3e971d12a03 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1442 microversion: 2.1 time: 0.314521 Jan 28 02:00:05.177215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 280/563] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:04 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1442 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:05.182362 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:05.182990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 9ae16871-7072-45bc-9498-b2187c59cb1f] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:05.202721 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.203454 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.204407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.205174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.232528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] HTTP exception thrown: Instance 9ae16871-7072-45bc-9498-b2187c59cb1f could not be found. Jan 28 02:00:05.233595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Returning 404 to user: Instance 9ae16871-7072-45bc-9498-b2187c59cb1f could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:00:05.234992 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cc3e6348-2c9b-45ec-b77b-5fde4ccfa1ae tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f" status: 404 len: 111 microversion: 2.1 time: 0.056554 Jan 28 02:00:05.236158 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 281/564] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:05 2022] GET /compute/v2.1/servers/9ae16871-7072-45bc-9498-b2187c59cb1f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:00:05.244677 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7d94c47d-ba35-427b-adb4-b3bf45999746 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:05.246739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7d94c47d-ba35-427b-adb4-b3bf45999746 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:05.258080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d94c47d-ba35-427b-adb4-b3bf45999746 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.258886 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d94c47d-ba35-427b-adb4-b3bf45999746 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.260318 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d94c47d-ba35-427b-adb4-b3bf45999746 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.261132 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d94c47d-ba35-427b-adb4-b3bf45999746 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.274650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2b6b2791-04f8-4ff6-869a-4774adc070c0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:05.289869 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2b6b2791-04f8-4ff6-869a-4774adc070c0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.337511 Jan 28 02:00:05.291752 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 284/565] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:04 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:05.300646 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-20f95a3f-9b74-462d-b682-914e75e187b7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:05.302736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-20f95a3f-9b74-462d-b682-914e75e187b7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:05.316319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20f95a3f-9b74-462d-b682-914e75e187b7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.317071 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20f95a3f-9b74-462d-b682-914e75e187b7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.318249 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20f95a3f-9b74-462d-b682-914e75e187b7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.318904 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20f95a3f-9b74-462d-b682-914e75e187b7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.368347 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-20f95a3f-9b74-462d-b682-914e75e187b7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:00:05.523731 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-20f95a3f-9b74-462d-b682-914e75e187b7 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "DELETE /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 204 len: 0 microversion: 2.1 time: 0.229571 Jan 28 02:00:05.524728 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 285/566] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:00:05 2022] DELETE /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:00:05.534905 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-59bc509d-ba69-4302-b72e-2719ae597d54 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:05.535780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-59bc509d-ba69-4302-b72e-2719ae597d54 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:05.544632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-59bc509d-ba69-4302-b72e-2719ae597d54 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.545582 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-59bc509d-ba69-4302-b72e-2719ae597d54 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.546733 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-59bc509d-ba69-4302-b72e-2719ae597d54 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.547374 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-59bc509d-ba69-4302-b72e-2719ae597d54 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.590718 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7d94c47d-ba35-427b-adb4-b3bf45999746 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:05.610480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7d94c47d-ba35-427b-adb4-b3bf45999746 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1442 microversion: 2.1 time: 0.372597 Jan 28 02:00:05.622710 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 282/567] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:05 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1442 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:05.737330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-59bc509d-ba69-4302-b72e-2719ae597d54 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:05.762005 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-59bc509d-ba69-4302-b72e-2719ae597d54 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.216602 Jan 28 02:00:05.762005 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 286/568] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:05 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:05.880990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-852512e8-f95e-4ff9-af53-2005f7b4bf1d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:05.881930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-852512e8-f95e-4ff9-af53-2005f7b4bf1d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:05.901921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-852512e8-f95e-4ff9-af53-2005f7b4bf1d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.917127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:05.919452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:05.920624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-852512e8-f95e-4ff9-af53-2005f7b4bf1d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.922496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-852512e8-f95e-4ff9-af53-2005f7b4bf1d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.928081 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-852512e8-f95e-4ff9-af53-2005f7b4bf1d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.941117 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.953900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:05.955659 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:05.956607 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:06.376495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-852512e8-f95e-4ff9-af53-2005f7b4bf1d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:06.395758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-852512e8-f95e-4ff9-af53-2005f7b4bf1d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.520606 Jan 28 02:00:06.413744 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:06.415699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 283/569] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:05 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:06.426324 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-29f9a7f6-4062-4515-a1ba-4b961233e626 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:06.427637 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-29f9a7f6-4062-4515-a1ba-4b961233e626 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:06.436955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:06.439967 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:06.441867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29f9a7f6-4062-4515-a1ba-4b961233e626 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:06.442069 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-79737e94-aa84-4613-b099-ba095cbced78 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.531619 Jan 28 02:00:06.442991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 287/570] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:05 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:06.453075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29f9a7f6-4062-4515-a1ba-4b961233e626 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:06.457302 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29f9a7f6-4062-4515-a1ba-4b961233e626 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:06.458433 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29f9a7f6-4062-4515-a1ba-4b961233e626 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:06.774883 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-29acdad1-8891-46b8-80ea-468fa4430d28 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:06.776876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-29acdad1-8891-46b8-80ea-468fa4430d28 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:06.790506 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29acdad1-8891-46b8-80ea-468fa4430d28 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:06.791669 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29acdad1-8891-46b8-80ea-468fa4430d28 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:06.794403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29acdad1-8891-46b8-80ea-468fa4430d28 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:06.795539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29acdad1-8891-46b8-80ea-468fa4430d28 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:06.948827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-29f9a7f6-4062-4515-a1ba-4b961233e626 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:06.963144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-29f9a7f6-4062-4515-a1ba-4b961233e626 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.545275 Jan 28 02:00:06.965799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 284/571] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:06 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:07.161838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-29acdad1-8891-46b8-80ea-468fa4430d28 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:07.176567 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-29acdad1-8891-46b8-80ea-468fa4430d28 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.408678 Jan 28 02:00:07.193369 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 288/572] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:06 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:07.428165 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ede6f57d-20a9-4798-a626-257061c2c812 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:07.429759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ede6f57d-20a9-4798-a626-257061c2c812 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:07.443722 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ede6f57d-20a9-4798-a626-257061c2c812 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:07.445182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ede6f57d-20a9-4798-a626-257061c2c812 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:07.447153 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ede6f57d-20a9-4798-a626-257061c2c812 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:07.448033 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ede6f57d-20a9-4798-a626-257061c2c812 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:07.477793 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:07.480497 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:07.494037 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:07.494990 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:07.497098 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:07.498357 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:07.838822 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:07.850717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:07.852870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:07.854393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1404ff12-9ae5-4f67-ae24-78965f841059 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.383305 Jan 28 02:00:07.854788 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 289/573] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:07 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:07.912224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ede6f57d-20a9-4798-a626-257061c2c812 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:07.924651 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ede6f57d-20a9-4798-a626-257061c2c812 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.503836 Jan 28 02:00:07.925947 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 285/574] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:07 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:07.995105 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cfe55758-9e63-4111-a3d2-1d3397151eec tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:08.009040 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cfe55758-9e63-4111-a3d2-1d3397151eec tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:08.019953 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cfe55758-9e63-4111-a3d2-1d3397151eec tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:08.020764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cfe55758-9e63-4111-a3d2-1d3397151eec tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:08.022159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cfe55758-9e63-4111-a3d2-1d3397151eec tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:08.033458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cfe55758-9e63-4111-a3d2-1d3397151eec tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:08.203622 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6d432876-7644-4f27-86b1-f34438697228 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:08.205178 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6d432876-7644-4f27-86b1-f34438697228 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:08.213374 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d432876-7644-4f27-86b1-f34438697228 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:08.214267 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d432876-7644-4f27-86b1-f34438697228 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:08.215574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d432876-7644-4f27-86b1-f34438697228 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:08.216699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d432876-7644-4f27-86b1-f34438697228 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:08.484252 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cfe55758-9e63-4111-a3d2-1d3397151eec tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:08.514799 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cfe55758-9e63-4111-a3d2-1d3397151eec tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.525832 Jan 28 02:00:08.519412 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 290/575] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:07 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:08.688769 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6d432876-7644-4f27-86b1-f34438697228 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:08.707350 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6d432876-7644-4f27-86b1-f34438697228 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.508288 Jan 28 02:00:08.713236 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 286/576] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:08 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:08.874370 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:08.874927 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:08.887817 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:08.889816 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:08.892041 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:08.900359 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:08.947686 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e5e10252-bd74-4f08-a917-d70fd5a24054 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:08.948329 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e5e10252-bd74-4f08-a917-d70fd5a24054 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:08.958209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e5e10252-bd74-4f08-a917-d70fd5a24054 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:08.958209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e5e10252-bd74-4f08-a917-d70fd5a24054 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:08.958209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e5e10252-bd74-4f08-a917-d70fd5a24054 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:08.958624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e5e10252-bd74-4f08-a917-d70fd5a24054 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:09.251773 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:09.263031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:09.263709 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e5e10252-bd74-4f08-a917-d70fd5a24054 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:09.265213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:09.266615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-abed5aa5-a630-420b-8b3a-d0db596b9c87 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.396779 Jan 28 02:00:09.278297 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e5e10252-bd74-4f08-a917-d70fd5a24054 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.336582 Jan 28 02:00:09.279027 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 291/577] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:08 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:09.284871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 287/578] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:08 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:09.556192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4a5810c4-f2be-4922-8f17-551a9fb06ece tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:09.556860 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4a5810c4-f2be-4922-8f17-551a9fb06ece tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:09.568717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a5810c4-f2be-4922-8f17-551a9fb06ece tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:09.569562 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a5810c4-f2be-4922-8f17-551a9fb06ece tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:09.570977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a5810c4-f2be-4922-8f17-551a9fb06ece tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:09.571776 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a5810c4-f2be-4922-8f17-551a9fb06ece tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:09.736844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1e90f78d-379f-4c9a-9fcf-7a940c8d8af0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:09.739898 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1e90f78d-379f-4c9a-9fcf-7a940c8d8af0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:09.762382 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e90f78d-379f-4c9a-9fcf-7a940c8d8af0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:09.764010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e90f78d-379f-4c9a-9fcf-7a940c8d8af0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:09.766347 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e90f78d-379f-4c9a-9fcf-7a940c8d8af0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:09.767797 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e90f78d-379f-4c9a-9fcf-7a940c8d8af0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:10.005394 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4a5810c4-f2be-4922-8f17-551a9fb06ece tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:10.013599 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4a5810c4-f2be-4922-8f17-551a9fb06ece tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.472324 Jan 28 02:00:10.014189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 292/579] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:09 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:10.019029 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-c5e5a1a6-6051-44ef-8cf3-91c4f206b234 req-e4bb37b0-9bd4-486d-9c26-3a8ea799c60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a298e144-76c9-46a8-9fd3-10930cffe935", "tag": "1938f369-8c3b-46ca-90e4-040b0e1f5517"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:10.031274 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:10.031274 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:00:10.048052 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c5e5a1a6-6051-44ef-8cf3-91c4f206b234 req-e4bb37b0-9bd4-486d-9c26-3a8ea799c60f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:10.048503 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c5e5a1a6-6051-44ef-8cf3-91c4f206b234 req-e4bb37b0-9bd4-486d-9c26-3a8ea799c60f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:10.086931 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-c5e5a1a6-6051-44ef-8cf3-91c4f206b234 req-e4bb37b0-9bd4-486d-9c26-3a8ea799c60f service nova] Creating event network-changed:1938f369-8c3b-46ca-90e4-040b0e1f5517 for instance a298e144-76c9-46a8-9fd3-10930cffe935 on hv-cinder-82497 Jan 28 02:00:10.106161 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-c5e5a1a6-6051-44ef-8cf3-91c4f206b234 req-e4bb37b0-9bd4-486d-9c26-3a8ea799c60f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090116 Jan 28 02:00:10.106761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 293/580] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:10.162102 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1e90f78d-379f-4c9a-9fcf-7a940c8d8af0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:10.172126 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1e90f78d-379f-4c9a-9fcf-7a940c8d8af0 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.449291 Jan 28 02:00:10.173005 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 288/581] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:09 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:10.288032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:10.292383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:10.299903 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:10.300368 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:10.301213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:10.301845 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:10.308241 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bef95ed5-6efe-4303-b5b1-9cb05d5730ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:10.309914 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bef95ed5-6efe-4303-b5b1-9cb05d5730ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:10.319796 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bef95ed5-6efe-4303-b5b1-9cb05d5730ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:10.320591 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bef95ed5-6efe-4303-b5b1-9cb05d5730ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:10.321617 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bef95ed5-6efe-4303-b5b1-9cb05d5730ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:10.324375 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bef95ed5-6efe-4303-b5b1-9cb05d5730ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:10.662814 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bef95ed5-6efe-4303-b5b1-9cb05d5730ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:10.676065 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:10.685848 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:10.687425 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:10.688738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f141e193-1b25-4abb-af3d-b84752d8e697 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.405829 Jan 28 02:00:10.691476 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bef95ed5-6efe-4303-b5b1-9cb05d5730ca tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.386797 Jan 28 02:00:10.692075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 289/582] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:10 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:10.693774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 294/583] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:10 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:11.040837 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4a25e510-a1de-4264-a9d9-318835667877 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:11.041570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4a25e510-a1de-4264-a9d9-318835667877 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:11.060534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a25e510-a1de-4264-a9d9-318835667877 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:11.060534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a25e510-a1de-4264-a9d9-318835667877 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:11.067586 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a25e510-a1de-4264-a9d9-318835667877 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:11.068131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a25e510-a1de-4264-a9d9-318835667877 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:11.197115 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-50cb6bcb-06c7-4426-acfb-f107286ca25d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:11.201300 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-50cb6bcb-06c7-4426-acfb-f107286ca25d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:11.214245 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50cb6bcb-06c7-4426-acfb-f107286ca25d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:11.216473 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50cb6bcb-06c7-4426-acfb-f107286ca25d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:11.224607 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50cb6bcb-06c7-4426-acfb-f107286ca25d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:11.225768 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50cb6bcb-06c7-4426-acfb-f107286ca25d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:11.430731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4a25e510-a1de-4264-a9d9-318835667877 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:11.448230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4a25e510-a1de-4264-a9d9-318835667877 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.410657 Jan 28 02:00:11.450259 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 290/584] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:11 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:11.531299 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-50cb6bcb-06c7-4426-acfb-f107286ca25d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:11.553692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-50cb6bcb-06c7-4426-acfb-f107286ca25d tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.356234 Jan 28 02:00:11.553692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 295/585] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:11 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:11.725557 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:11.728064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dbe49327-b540-4041-bf95-95b9a2b520b3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:11.728941 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dbe49327-b540-4041-bf95-95b9a2b520b3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:11.729960 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:11.736476 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dbe49327-b540-4041-bf95-95b9a2b520b3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:11.737161 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:11.737575 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dbe49327-b540-4041-bf95-95b9a2b520b3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:11.737712 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:11.738401 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:11.738840 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:11.739146 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dbe49327-b540-4041-bf95-95b9a2b520b3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:11.739782 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dbe49327-b540-4041-bf95-95b9a2b520b3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:12.026286 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:12.036846 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:12.038416 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dbe49327-b540-4041-bf95-95b9a2b520b3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:12.038937 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:12.040393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d1437aca-278c-4836-9f8d-7e6bb54b4e86 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.319427 Jan 28 02:00:12.051672 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 296/586] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:11 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:12.051913 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dbe49327-b540-4041-bf95-95b9a2b520b3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.332383 Jan 28 02:00:12.053184 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 291/587] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:11 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:12.480534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3e3e7686-94b8-472b-aeee-a5ef4e2fac91 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:12.480901 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3e3e7686-94b8-472b-aeee-a5ef4e2fac91 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:12.487219 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3e3e7686-94b8-472b-aeee-a5ef4e2fac91 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:12.487657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3e3e7686-94b8-472b-aeee-a5ef4e2fac91 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:12.488437 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3e3e7686-94b8-472b-aeee-a5ef4e2fac91 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:12.488958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3e3e7686-94b8-472b-aeee-a5ef4e2fac91 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:12.567947 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-03ed0bd0-9176-49ba-bed0-631b1c6df487 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:12.570117 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-03ed0bd0-9176-49ba-bed0-631b1c6df487 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:12.583279 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-03ed0bd0-9176-49ba-bed0-631b1c6df487 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:12.584462 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-03ed0bd0-9176-49ba-bed0-631b1c6df487 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:12.587114 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-03ed0bd0-9176-49ba-bed0-631b1c6df487 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:12.589008 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-03ed0bd0-9176-49ba-bed0-631b1c6df487 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:12.695364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3e3e7686-94b8-472b-aeee-a5ef4e2fac91 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:12.710869 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3e3e7686-94b8-472b-aeee-a5ef4e2fac91 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.233976 Jan 28 02:00:12.712497 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 297/588] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:12 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:12.799062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-03ed0bd0-9176-49ba-bed0-631b1c6df487 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:12.809540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-03ed0bd0-9176-49ba-bed0-631b1c6df487 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.250962 Jan 28 02:00:12.810655 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 292/589] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:12 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:13.060113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:13.060958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:13.067457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:13.067997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:13.068898 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:13.069750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:13.071251 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-928c088b-4e20-4aa3-a459-7b5725cadcf2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:13.071939 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-928c088b-4e20-4aa3-a459-7b5725cadcf2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:13.080677 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-928c088b-4e20-4aa3-a459-7b5725cadcf2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:13.081956 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-928c088b-4e20-4aa3-a459-7b5725cadcf2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:13.087534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-928c088b-4e20-4aa3-a459-7b5725cadcf2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:13.088103 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-928c088b-4e20-4aa3-a459-7b5725cadcf2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:13.279780 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-928c088b-4e20-4aa3-a459-7b5725cadcf2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:13.284293 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:13.288176 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-928c088b-4e20-4aa3-a459-7b5725cadcf2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.221235 Jan 28 02:00:13.294254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:13.295795 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:13.297476 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-698ece50-6b54-444b-af2d-bc932c5e427a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.241879 Jan 28 02:00:13.298054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 293/590] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:13 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:13.298220 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 298/591] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:13 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:00:13.729217 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0016997a-a6a9-442b-b0fd-5bd51e838b3f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:13.729838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0016997a-a6a9-442b-b0fd-5bd51e838b3f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:13.736212 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0016997a-a6a9-442b-b0fd-5bd51e838b3f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:13.736664 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0016997a-a6a9-442b-b0fd-5bd51e838b3f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:13.737535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0016997a-a6a9-442b-b0fd-5bd51e838b3f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:13.737969 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0016997a-a6a9-442b-b0fd-5bd51e838b3f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:13.828201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4a4dd05b-e459-4787-8523-c7708897b5ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:13.828828 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4a4dd05b-e459-4787-8523-c7708897b5ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:13.843798 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a4dd05b-e459-4787-8523-c7708897b5ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:13.844466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a4dd05b-e459-4787-8523-c7708897b5ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:13.845433 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a4dd05b-e459-4787-8523-c7708897b5ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:13.845875 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a4dd05b-e459-4787-8523-c7708897b5ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:13.870510 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0016997a-a6a9-442b-b0fd-5bd51e838b3f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:13.878150 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0016997a-a6a9-442b-b0fd-5bd51e838b3f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.152604 Jan 28 02:00:13.878818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 294/592] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:13 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:13.971213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4a4dd05b-e459-4787-8523-c7708897b5ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:13.978618 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4a4dd05b-e459-4787-8523-c7708897b5ca tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.154653 Jan 28 02:00:13.979183 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 299/593] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:13 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:14.306173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-72266943-c211-4681-9253-2d2f99ef2fff tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:14.306948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-72266943-c211-4681-9253-2d2f99ef2fff tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:14.314258 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72266943-c211-4681-9253-2d2f99ef2fff tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:14.314971 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72266943-c211-4681-9253-2d2f99ef2fff tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:14.315911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72266943-c211-4681-9253-2d2f99ef2fff tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:14.316483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72266943-c211-4681-9253-2d2f99ef2fff tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:14.316669 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:14.317541 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:14.323985 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:14.325087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:14.325896 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:14.326336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:14.751952 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-72266943-c211-4681-9253-2d2f99ef2fff tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:14.760684 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-72266943-c211-4681-9253-2d2f99ef2fff tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.459008 Jan 28 02:00:14.762026 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 295/594] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:14 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:14.765240 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:14.773962 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:14.775566 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:14.776825 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f87b3540-da3b-4bad-9b97-da4e42c29730 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.463953 Jan 28 02:00:14.778780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 300/595] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:14 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:00:14.895272 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b4b7b9d0-2759-4eb8-a814-b3791ef3a28a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:14.895892 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b4b7b9d0-2759-4eb8-a814-b3791ef3a28a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:14.901857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4b7b9d0-2759-4eb8-a814-b3791ef3a28a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:14.902305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4b7b9d0-2759-4eb8-a814-b3791ef3a28a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:14.903465 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4b7b9d0-2759-4eb8-a814-b3791ef3a28a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:14.903850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4b7b9d0-2759-4eb8-a814-b3791ef3a28a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:14.996263 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-79459a2a-6521-4a12-bb0a-db86e2d9aff9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:14.997204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-79459a2a-6521-4a12-bb0a-db86e2d9aff9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:15.004065 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79459a2a-6521-4a12-bb0a-db86e2d9aff9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:15.004510 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79459a2a-6521-4a12-bb0a-db86e2d9aff9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:15.005321 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79459a2a-6521-4a12-bb0a-db86e2d9aff9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:15.005787 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79459a2a-6521-4a12-bb0a-db86e2d9aff9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:15.156360 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b4b7b9d0-2759-4eb8-a814-b3791ef3a28a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:15.163846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b4b7b9d0-2759-4eb8-a814-b3791ef3a28a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1318 microversion: 2.1 time: 0.272118 Jan 28 02:00:15.164422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 296/596] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:14 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:15.233948 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-79459a2a-6521-4a12-bb0a-db86e2d9aff9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:15.241786 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-79459a2a-6521-4a12-bb0a-db86e2d9aff9 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.250357 Jan 28 02:00:15.242367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 301/597] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:14 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:15.779320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cb8ebf83-3c17-4c49-9f60-96c5fd2698de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:15.779945 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cb8ebf83-3c17-4c49-9f60-96c5fd2698de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:15.786170 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb8ebf83-3c17-4c49-9f60-96c5fd2698de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:15.786617 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb8ebf83-3c17-4c49-9f60-96c5fd2698de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:15.787398 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb8ebf83-3c17-4c49-9f60-96c5fd2698de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:15.787831 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb8ebf83-3c17-4c49-9f60-96c5fd2698de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:15.800658 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:15.802136 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:15.812111 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:15.812942 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:15.814310 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:15.815128 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:16.005149 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cb8ebf83-3c17-4c49-9f60-96c5fd2698de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:16.015081 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cb8ebf83-3c17-4c49-9f60-96c5fd2698de tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.240063 Jan 28 02:00:16.015943 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 297/598] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:15 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:16.020564 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:16.031306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:16.032847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:16.034061 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3ecb7bea-92e0-42b5-b98d-acad0d77c887 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.241255 Jan 28 02:00:16.034633 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 302/599] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:15 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:16.187815 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b277a872-f70f-4b95-b14d-ceebfe006199 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:16.188423 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b277a872-f70f-4b95-b14d-ceebfe006199 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:16.194385 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b277a872-f70f-4b95-b14d-ceebfe006199 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:16.194838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b277a872-f70f-4b95-b14d-ceebfe006199 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:16.195610 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b277a872-f70f-4b95-b14d-ceebfe006199 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:16.196043 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b277a872-f70f-4b95-b14d-ceebfe006199 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:16.258739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-45738032-5b57-4c53-af8f-b399a864323f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:16.259347 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-45738032-5b57-4c53-af8f-b399a864323f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:16.265912 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-45738032-5b57-4c53-af8f-b399a864323f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:16.266842 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-45738032-5b57-4c53-af8f-b399a864323f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:16.267229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-45738032-5b57-4c53-af8f-b399a864323f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:16.267673 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-45738032-5b57-4c53-af8f-b399a864323f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:16.374372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b277a872-f70f-4b95-b14d-ceebfe006199 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:16.381801 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b277a872-f70f-4b95-b14d-ceebfe006199 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1506 microversion: 2.1 time: 0.198082 Jan 28 02:00:16.382381 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 298/600] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:16 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:16.433137 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-45738032-5b57-4c53-af8f-b399a864323f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:16.441581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-45738032-5b57-4c53-af8f-b399a864323f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1515 microversion: 2.1 time: 0.186961 Jan 28 02:00:16.442178 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 303/601] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:16 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:17.032855 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c1798c02-2f29-4de4-ad2f-03e9271f7cdf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:17.033560 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c1798c02-2f29-4de4-ad2f-03e9271f7cdf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:17.039409 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1798c02-2f29-4de4-ad2f-03e9271f7cdf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:17.039963 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1798c02-2f29-4de4-ad2f-03e9271f7cdf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:17.040835 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1798c02-2f29-4de4-ad2f-03e9271f7cdf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:17.041350 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1798c02-2f29-4de4-ad2f-03e9271f7cdf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:17.052558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:17.053910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:17.060431 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:17.060913 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:17.061689 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:17.062124 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:17.358305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c1798c02-2f29-4de4-ad2f-03e9271f7cdf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:17.363391 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:17.398725 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:17.401145 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:17.402518 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-07bf6147-d1f9-43b3-8f38-72e3050ba2c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.353568 Jan 28 02:00:17.404004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c1798c02-2f29-4de4-ad2f-03e9271f7cdf tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1568 microversion: 2.1 time: 0.365052 Jan 28 02:00:17.404707 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 299/602] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:17 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1568 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:17.405232 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 304/603] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:17 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:00:17.413685 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-1c59aa71-5171-4b41-a5ef-781e1284f5e9 req-4a54d8eb-1f8c-4b55-8907-7aa17cc67f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d2fd8d-b37d-47af-8c84-b481723641aa", "name": "network-vif-deleted", "tag": "770e2a60-f836-46bc-ba19-66a19ac3ab81"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:17.417088 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:17.417088 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:00:17.429998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-1c59aa71-5171-4b41-a5ef-781e1284f5e9 req-4a54d8eb-1f8c-4b55-8907-7aa17cc67f8d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:17.431074 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-1c59aa71-5171-4b41-a5ef-781e1284f5e9 req-4a54d8eb-1f8c-4b55-8907-7aa17cc67f8d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:17.450672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-1c59aa71-5171-4b41-a5ef-781e1284f5e9 req-4a54d8eb-1f8c-4b55-8907-7aa17cc67f8d service nova] Creating event network-vif-deleted:770e2a60-f836-46bc-ba19-66a19ac3ab81 for instance d4d2fd8d-b37d-47af-8c84-b481723641aa on hv-cinder-82497 Jan 28 02:00:17.460671 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6d0bb33f-305f-4933-a226-4f3a25567217 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:17.461493 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-1c59aa71-5171-4b41-a5ef-781e1284f5e9 req-4a54d8eb-1f8c-4b55-8907-7aa17cc67f8d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053420 Jan 28 02:00:17.461781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6d0bb33f-305f-4933-a226-4f3a25567217 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:17.462931 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 300/604] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:17.470079 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d0bb33f-305f-4933-a226-4f3a25567217 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:17.470587 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d0bb33f-305f-4933-a226-4f3a25567217 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:17.471411 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d0bb33f-305f-4933-a226-4f3a25567217 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:17.471865 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d0bb33f-305f-4933-a226-4f3a25567217 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:17.546082 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6d0bb33f-305f-4933-a226-4f3a25567217 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:17.567194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6d0bb33f-305f-4933-a226-4f3a25567217 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 200 len: 1303 microversion: 2.1 time: 0.110769 Jan 28 02:00:17.568469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 305/605] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:17 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:18.423241 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:18.424057 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:18.425167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fafdedfd-2bb9-4a4d-b407-393629715bda tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:18.425974 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fafdedfd-2bb9-4a4d-b407-393629715bda tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:18.433232 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fafdedfd-2bb9-4a4d-b407-393629715bda tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.434473 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fafdedfd-2bb9-4a4d-b407-393629715bda tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.437696 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fafdedfd-2bb9-4a4d-b407-393629715bda tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.437696 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fafdedfd-2bb9-4a4d-b407-393629715bda tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.441570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.441570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.441570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.441570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.645083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:18.648853 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fafdedfd-2bb9-4a4d-b407-393629715bda tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:18.655766 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:18.657575 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:18.658212 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fafdedfd-2bb9-4a4d-b407-393629715bda tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1548 microversion: 2.1 time: 0.237292 Jan 28 02:00:18.658806 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-54ca987c-bcd8-4980-a1f4-b8f9a69551e1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.241106 Jan 28 02:00:18.658992 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 306/606] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:18 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1548 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:18.668859 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 301/607] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:18 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:18.669119 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:18.669119 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: d4d2fd8d-b37d-47af-8c84-b481723641aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:18.677827 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.678757 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.679668 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.680183 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.683230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:18.686090 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:18.695438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] HTTP exception thrown: Instance d4d2fd8d-b37d-47af-8c84-b481723641aa could not be found. Jan 28 02:00:18.696050 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Returning 404 to user: Instance d4d2fd8d-b37d-47af-8c84-b481723641aa could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:00:18.696938 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e9d1c435-fe0b-4256-a45c-f4f8e694aade tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa" status: 404 len: 111 microversion: 2.1 time: 0.037090 Jan 28 02:00:18.697508 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 307/608] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:18 2022] GET /compute/v2.1/servers/d4d2fd8d-b37d-47af-8c84-b481723641aa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:00:18.698339 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.699882 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.701432 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.702189 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.808031 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] HTTP exception thrown: Cannot 'detach_volume' instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c while it is in vm_state rescued Jan 28 02:00:18.809323 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Returning 409 to user: Cannot 'detach_volume' instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c while it is in vm_state rescued {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:00:18.810366 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1fb4454c-579b-4023-8d60-75809dd4512d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "DELETE /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments/e7021390-1659-4780-98cd-2e2bbc521ed8" status: 409 len: 152 microversion: 2.1 time: 0.138189 Jan 28 02:00:18.810964 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 302/609] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:00:18 2022] DELETE /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments/e7021390-1659-4780-98cd-2e2bbc521ed8 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 02:00:18.820024 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c5602f38-94e0-4494-9cd5-532ca6a28c41 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:18.820732 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c5602f38-94e0-4494-9cd5-532ca6a28c41 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:18.829026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5602f38-94e0-4494-9cd5-532ca6a28c41 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.829026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5602f38-94e0-4494-9cd5-532ca6a28c41 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.829400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5602f38-94e0-4494-9cd5-532ca6a28c41 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.829843 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5602f38-94e0-4494-9cd5-532ca6a28c41 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.901942 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c5602f38-94e0-4494-9cd5-532ca6a28c41 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/action" status: 202 len: 0 microversion: 2.1 time: 0.085766 Jan 28 02:00:18.903355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 308/610] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:00:18 2022] POST /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:00:18.911563 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-940b769e-c069-452b-85d0-bf24a527ddd5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:18.912254 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-940b769e-c069-452b-85d0-bf24a527ddd5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:18.919880 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-940b769e-c069-452b-85d0-bf24a527ddd5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.920431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-940b769e-c069-452b-85d0-bf24a527ddd5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:18.923310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-940b769e-c069-452b-85d0-bf24a527ddd5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:18.923834 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-940b769e-c069-452b-85d0-bf24a527ddd5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:19.099514 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-940b769e-c069-452b-85d0-bf24a527ddd5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:19.109168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-940b769e-c069-452b-85d0-bf24a527ddd5 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1556 microversion: 2.1 time: 0.201185 Jan 28 02:00:19.109984 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 303/611] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:18 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:19.687955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:19.688653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:19.694781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:19.695288 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:19.696009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:19.696452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:19.830173 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:19.838496 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:19.840650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:19.841911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2bef0b26-4b0c-4ac9-9347-ddc085b124c3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.159415 Jan 28 02:00:19.842550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 309/612] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:19 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:19.873215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-32bb0aec-e552-4429-b9da-75c55e89a20f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:19.873799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-32bb0aec-e552-4429-b9da-75c55e89a20f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:19.879734 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32bb0aec-e552-4429-b9da-75c55e89a20f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:19.880183 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32bb0aec-e552-4429-b9da-75c55e89a20f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:19.881007 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32bb0aec-e552-4429-b9da-75c55e89a20f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:19.881441 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32bb0aec-e552-4429-b9da-75c55e89a20f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:19.907001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-32bb0aec-e552-4429-b9da-75c55e89a20f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:00:19.990242 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-32bb0aec-e552-4429-b9da-75c55e89a20f tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "DELETE /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 204 len: 0 microversion: 2.1 time: 0.121881 Jan 28 02:00:19.991074 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 304/613] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:00:19 2022] DELETE /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:00:19.999828 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f186bd64-d7fd-4867-b87b-94a1ef77d43a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:20.000464 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f186bd64-d7fd-4867-b87b-94a1ef77d43a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:20.008064 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f186bd64-d7fd-4867-b87b-94a1ef77d43a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:20.008529 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f186bd64-d7fd-4867-b87b-94a1ef77d43a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:20.009536 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f186bd64-d7fd-4867-b87b-94a1ef77d43a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:20.009968 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f186bd64-d7fd-4867-b87b-94a1ef77d43a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:20.128488 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-595f80e1-4326-4c13-809a-6222f99710a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:20.129221 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-595f80e1-4326-4c13-809a-6222f99710a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:20.135059 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-595f80e1-4326-4c13-809a-6222f99710a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:20.135513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-595f80e1-4326-4c13-809a-6222f99710a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:20.136341 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-595f80e1-4326-4c13-809a-6222f99710a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:20.137483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-595f80e1-4326-4c13-809a-6222f99710a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:20.139479 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f186bd64-d7fd-4867-b87b-94a1ef77d43a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:20.147246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f186bd64-d7fd-4867-b87b-94a1ef77d43a tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1514 microversion: 2.1 time: 0.152039 Jan 28 02:00:20.147806 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 310/614] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:19 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:20.283665 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-595f80e1-4326-4c13-809a-6222f99710a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:20.293316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-595f80e1-4326-4c13-809a-6222f99710a3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1556 microversion: 2.1 time: 0.168165 Jan 28 02:00:20.294128 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 305/615] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:20 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:20.862996 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:20.863535 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:20.870155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:20.870650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:20.871587 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:20.872019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:21.023753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:21.033430 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:21.034913 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:21.036196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2c8635f9-f91d-4156-9780-8a6fe5ab1e23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.177047 Jan 28 02:00:21.036841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 311/616] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:20 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:21.166211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dceabaa9-0325-44a4-908b-f05f0657d48b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:21.166980 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dceabaa9-0325-44a4-908b-f05f0657d48b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:21.174046 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dceabaa9-0325-44a4-908b-f05f0657d48b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:21.174498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dceabaa9-0325-44a4-908b-f05f0657d48b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:21.175300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dceabaa9-0325-44a4-908b-f05f0657d48b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:21.175738 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dceabaa9-0325-44a4-908b-f05f0657d48b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:21.298767 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dceabaa9-0325-44a4-908b-f05f0657d48b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:21.306120 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dceabaa9-0325-44a4-908b-f05f0657d48b tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1514 microversion: 2.1 time: 0.143749 Jan 28 02:00:21.306677 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 306/617] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:21 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:21.313383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2d31cba4-26a3-443b-909f-962635be226e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:21.314080 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2d31cba4-26a3-443b-909f-962635be226e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:21.319971 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d31cba4-26a3-443b-909f-962635be226e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:21.320415 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d31cba4-26a3-443b-909f-962635be226e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:21.321222 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d31cba4-26a3-443b-909f-962635be226e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:21.321663 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d31cba4-26a3-443b-909f-962635be226e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:21.457031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2d31cba4-26a3-443b-909f-962635be226e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:21.465793 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2d31cba4-26a3-443b-909f-962635be226e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1556 microversion: 2.1 time: 0.155751 Jan 28 02:00:21.466440 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 312/618] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:21 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:22.060333 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:22.061552 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:22.070923 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:22.071561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:22.072484 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:22.073093 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:22.229662 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:22.239330 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:22.240923 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:22.242212 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5132db14-abed-415b-b2ab-3f4f80db0107 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.189742 Jan 28 02:00:22.243026 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 307/619] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:22 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:22.323143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-35b34233-2063-41bc-bb21-6dac4de66e64 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:22.323916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-35b34233-2063-41bc-bb21-6dac4de66e64 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:22.329891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35b34233-2063-41bc-bb21-6dac4de66e64 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:22.330341 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35b34233-2063-41bc-bb21-6dac4de66e64 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:22.331107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35b34233-2063-41bc-bb21-6dac4de66e64 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:22.331543 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35b34233-2063-41bc-bb21-6dac4de66e64 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:22.461751 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-35b34233-2063-41bc-bb21-6dac4de66e64 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:22.470201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-35b34233-2063-41bc-bb21-6dac4de66e64 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1514 microversion: 2.1 time: 0.150694 Jan 28 02:00:22.471237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 313/620] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:22 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:22.496186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1d23fd4f-1eb9-489a-8634-a2ce24352422 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:22.497336 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1d23fd4f-1eb9-489a-8634-a2ce24352422 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:22.506693 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1d23fd4f-1eb9-489a-8634-a2ce24352422 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:22.507135 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1d23fd4f-1eb9-489a-8634-a2ce24352422 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:22.508123 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1d23fd4f-1eb9-489a-8634-a2ce24352422 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:22.508569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1d23fd4f-1eb9-489a-8634-a2ce24352422 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:22.656988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1d23fd4f-1eb9-489a-8634-a2ce24352422 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:22.666071 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1d23fd4f-1eb9-489a-8634-a2ce24352422 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1556 microversion: 2.1 time: 0.178129 Jan 28 02:00:22.666628 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 308/621] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:22 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:23.265883 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:23.266910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:23.274833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.275288 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:23.276060 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.276494 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:23.485111 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:23.493682 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:23.495302 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:23.497323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fd011d42-6362-420d-b05c-30b656257f93 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.239921 Jan 28 02:00:23.502601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ecec6c87-03c7-45b1-877c-3ff1c8c80d86 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:23.507105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ecec6c87-03c7-45b1-877c-3ff1c8c80d86 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:23.508506 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 314/622] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:23 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:23.513582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ecec6c87-03c7-45b1-877c-3ff1c8c80d86 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.514031 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ecec6c87-03c7-45b1-877c-3ff1c8c80d86 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:23.514821 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ecec6c87-03c7-45b1-877c-3ff1c8c80d86 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.515357 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ecec6c87-03c7-45b1-877c-3ff1c8c80d86 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:23.683969 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bfacaaa7-2034-4242-83fa-216ee6e101b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:23.684825 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bfacaaa7-2034-4242-83fa-216ee6e101b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:23.693306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfacaaa7-2034-4242-83fa-216ee6e101b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.693958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfacaaa7-2034-4242-83fa-216ee6e101b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:23.695042 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfacaaa7-2034-4242-83fa-216ee6e101b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.695589 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfacaaa7-2034-4242-83fa-216ee6e101b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:23.759921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ecec6c87-03c7-45b1-877c-3ff1c8c80d86 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f57e62502564821b4be822554d9f5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f478fd06754a38b139c8415da6a514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:23.773184 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ecec6c87-03c7-45b1-877c-3ff1c8c80d86 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 200 len: 1514 microversion: 2.1 time: 0.274828 Jan 28 02:00:23.774181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 309/623] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:23 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:23.782291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-34a48e87-9c80-41a9-b148-09e9e62fc9e1 req-e65b2538-0001-458a-9384-2685e3c0afb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5194c2-f570-4463-8a44-765cf06f1206", "name": "network-vif-deleted", "tag": "cd5708fe-d124-49c1-b391-fcbc90e2b0d8"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:23.784589 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:23.784589 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:00:23.796367 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-34a48e87-9c80-41a9-b148-09e9e62fc9e1 req-e65b2538-0001-458a-9384-2685e3c0afb6 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.797031 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-34a48e87-9c80-41a9-b148-09e9e62fc9e1 req-e65b2538-0001-458a-9384-2685e3c0afb6 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:23.809870 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-34a48e87-9c80-41a9-b148-09e9e62fc9e1 req-e65b2538-0001-458a-9384-2685e3c0afb6 service nova] Creating event network-vif-deleted:cd5708fe-d124-49c1-b391-fcbc90e2b0d8 for instance 6e5194c2-f570-4463-8a44-765cf06f1206 on hv-cinder-82497 Jan 28 02:00:23.816117 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-34a48e87-9c80-41a9-b148-09e9e62fc9e1 req-e65b2538-0001-458a-9384-2685e3c0afb6 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039997 Jan 28 02:00:23.817328 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 310/624] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:23.881011 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bfacaaa7-2034-4242-83fa-216ee6e101b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:23.889888 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bfacaaa7-2034-4242-83fa-216ee6e101b4 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1562 microversion: 2.1 time: 0.210117 Jan 28 02:00:23.890472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 315/625] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:23 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1562 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:23.968124 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7f5010d7-7c04-4874-8802-6432593e687d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:23.968827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7f5010d7-7c04-4874-8802-6432593e687d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:23.975216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f5010d7-7c04-4874-8802-6432593e687d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.975664 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f5010d7-7c04-4874-8802-6432593e687d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:23.976439 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f5010d7-7c04-4874-8802-6432593e687d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:23.976975 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f5010d7-7c04-4874-8802-6432593e687d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:24.064624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-7f5010d7-7c04-4874-8802-6432593e687d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lazy-loading 'services' on Instance uuid d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:00:24.137550 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7f5010d7-7c04-4874-8802-6432593e687d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "DELETE /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments/e7021390-1659-4780-98cd-2e2bbc521ed8" status: 202 len: 0 microversion: 2.1 time: 0.173643 Jan 28 02:00:24.138646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 311/626] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:00:23 2022] DELETE /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments/e7021390-1659-4780-98cd-2e2bbc521ed8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:00:24.147009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3e0b98d3-af94-4261-abc6-2e2e6414455e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:24.148096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3e0b98d3-af94-4261-abc6-2e2e6414455e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:24.157892 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3e0b98d3-af94-4261-abc6-2e2e6414455e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:24.158349 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3e0b98d3-af94-4261-abc6-2e2e6414455e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:24.159509 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3e0b98d3-af94-4261-abc6-2e2e6414455e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:24.159635 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3e0b98d3-af94-4261-abc6-2e2e6414455e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:24.193332 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3e0b98d3-af94-4261-abc6-2e2e6414455e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050196 Jan 28 02:00:24.194016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 316/627] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:00:24 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:24.522450 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:24.523793 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:24.540996 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:24.541481 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:24.542289 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:24.543270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:24.794164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:24.794809 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] [instance: 6e5194c2-f570-4463-8a44-765cf06f1206] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:24.801826 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:24.802271 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:24.803075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:24.803511 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:24.819391 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] HTTP exception thrown: Instance 6e5194c2-f570-4463-8a44-765cf06f1206 could not be found. Jan 28 02:00:24.821094 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] Returning 404 to user: Instance 6e5194c2-f570-4463-8a44-765cf06f1206 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:00:24.822538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3cc6e059-c89d-429c-aa04-f40be98ba3f4 tempest-AttachVolumeNegativeTest-1129851201 tempest-AttachVolumeNegativeTest-1129851201-project] 10.222.0.96 "GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206" status: 404 len: 111 microversion: 2.1 time: 0.033458 Jan 28 02:00:24.823638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 317/628] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:24 2022] GET /compute/v2.1/servers/6e5194c2-f570-4463-8a44-765cf06f1206 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:00:24.951938 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:24.963998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:24.966428 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:24.967631 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bd979237-644a-43c1-9939-41ffd801e827 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.453394 Jan 28 02:00:24.968678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 312/629] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:24 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:25.209737 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-90133331-3756-40fb-a114-0c5ff52d328c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:25.211568 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-90133331-3756-40fb-a114-0c5ff52d328c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:25.224125 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90133331-3756-40fb-a114-0c5ff52d328c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:25.225002 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90133331-3756-40fb-a114-0c5ff52d328c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:25.226448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90133331-3756-40fb-a114-0c5ff52d328c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:25.227271 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90133331-3756-40fb-a114-0c5ff52d328c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:25.286547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-90133331-3756-40fb-a114-0c5ff52d328c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084130 Jan 28 02:00:25.287568 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 318/630] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:00:25 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:00:26.000105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:26.000710 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:26.009079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:26.009838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:26.010628 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:26.011061 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:26.171660 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:26.180433 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:26.182047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:26.183411 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f9b36a39-89cd-49d9-a10e-0f930a50a496 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.188215 Jan 28 02:00:26.184111 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 313/631] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:25 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:26.303814 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c985c76f-17b7-4fe7-8728-26fed624dec8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:26.305446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c985c76f-17b7-4fe7-8728-26fed624dec8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:26.312628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c985c76f-17b7-4fe7-8728-26fed624dec8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:26.313201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c985c76f-17b7-4fe7-8728-26fed624dec8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:26.313994 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c985c76f-17b7-4fe7-8728-26fed624dec8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:26.314430 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c985c76f-17b7-4fe7-8728-26fed624dec8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:26.347174 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c985c76f-17b7-4fe7-8728-26fed624dec8 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051353 Jan 28 02:00:26.347852 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 319/632] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:00:26 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:00:26.509349 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-299db952-df71-44d6-aa86-b959ba6861d2 req-c449397c-f2a2-41b4-b0b8-a51f46baec3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1879ef-ae58-41eb-9c13-3f9a3988a970", "name": "network-vif-plugged", "status": "completed", "tag": "d9332855-e3dc-42d6-9f2e-2138fd34387d"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:26.514200 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:26.514200 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:00:26.529225 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-299db952-df71-44d6-aa86-b959ba6861d2 req-c449397c-f2a2-41b4-b0b8-a51f46baec3f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:26.530746 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-299db952-df71-44d6-aa86-b959ba6861d2 req-c449397c-f2a2-41b4-b0b8-a51f46baec3f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:26.567204 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-299db952-df71-44d6-aa86-b959ba6861d2 req-c449397c-f2a2-41b4-b0b8-a51f46baec3f service nova] Creating event network-vif-plugged:d9332855-e3dc-42d6-9f2e-2138fd34387d for instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 on hv-cinder-82497 Jan 28 02:00:26.581233 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-299db952-df71-44d6-aa86-b959ba6861d2 req-c449397c-f2a2-41b4-b0b8-a51f46baec3f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079728 Jan 28 02:00:26.583149 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 314/633] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:27.204425 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:27.205313 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:27.215200 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:27.215980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:27.217309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:27.218033 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:27.406002 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:27.416081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:27.418159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:27.419688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-18ceec30-0aa7-41bc-b6dc-faf84618f978 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.221510 Jan 28 02:00:27.420408 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 320/634] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:27 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:28.443742 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:28.445084 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:28.453748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.454220 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.455058 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.455487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.514323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d4081696-3fc4-4447-a5d1-8123ce6761a5 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f3c1280>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:28.594447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d4081696-3fc4-4447-a5d1-8123ce6761a5 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/df1177ed-93a6-407e-99bf-927b81193952" status: 200 len: 350 microversion: 2.1 time: 0.088071 Jan 28 02:00:28.595254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 321/635] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 02:00:28 2022] GET /compute/v2.1/os-volumes/df1177ed-93a6-407e-99bf-927b81193952 => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:28.640303 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:28.649495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:28.651027 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:28.656674 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1c139377-7c37-4fbb-8c55-1fd63c887fa5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.220400 Jan 28 02:00:28.659111 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 315/636] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:28 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:28.741978 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5acda29e-176a-47d8-aacc-c989672b678d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:28.742384 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5acda29e-176a-47d8-aacc-c989672b678d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:28.748661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5acda29e-176a-47d8-aacc-c989672b678d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.749142 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5acda29e-176a-47d8-aacc-c989672b678d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.749908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5acda29e-176a-47d8-aacc-c989672b678d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.750336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5acda29e-176a-47d8-aacc-c989672b678d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.779550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5acda29e-176a-47d8-aacc-c989672b678d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:00:28.874117 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5acda29e-176a-47d8-aacc-c989672b678d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "DELETE /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 204 len: 0 microversion: 2.1 time: 0.136955 Jan 28 02:00:28.878090 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 322/637] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:00:28 2022] DELETE /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:00:28.885898 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a13b08e9-80b6-44f9-aaa5-e9bf4d3bd34e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:28.887469 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a13b08e9-80b6-44f9-aaa5-e9bf4d3bd34e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:28.894086 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a13b08e9-80b6-44f9-aaa5-e9bf4d3bd34e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.894883 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a13b08e9-80b6-44f9-aaa5-e9bf4d3bd34e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:28.895895 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a13b08e9-80b6-44f9-aaa5-e9bf4d3bd34e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:28.896529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a13b08e9-80b6-44f9-aaa5-e9bf4d3bd34e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:29.062054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a13b08e9-80b6-44f9-aaa5-e9bf4d3bd34e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:29.069885 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a13b08e9-80b6-44f9-aaa5-e9bf4d3bd34e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1508 microversion: 2.1 time: 0.188346 Jan 28 02:00:29.070481 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 316/638] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:28 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:29.688304 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:29.689326 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:29.700087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:29.700910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:29.701719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:29.702160 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:29.870637 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:29.886363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:29.889530 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:29.891864 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-90e0eb39-224e-479d-bf5b-6fdbae08b363 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1808 microversion: 2.20 time: 0.207622 Jan 28 02:00:29.892964 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 323/639] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:29 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:30.079518 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e59a91a4-fd7c-4fbf-ade1-ff826b98c88e tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f428790>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:30.087399 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-72994123-a84f-458a-95da-d91272678013 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:30.088021 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-72994123-a84f-458a-95da-d91272678013 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:30.095468 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72994123-a84f-458a-95da-d91272678013 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:30.096028 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72994123-a84f-458a-95da-d91272678013 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:30.097076 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72994123-a84f-458a-95da-d91272678013 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:30.097615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72994123-a84f-458a-95da-d91272678013 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:30.138489 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e59a91a4-fd7c-4fbf-ade1-ff826b98c88e tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/87d1c631-0c17-4aea-aeb8-f75d6365dfa7" status: 200 len: 351 microversion: 2.1 time: 0.062642 Jan 28 02:00:30.139064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 317/640] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 02:00:30 2022] GET /compute/v2.1/os-volumes/87d1c631-0c17-4aea-aeb8-f75d6365dfa7 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:30.244053 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-72994123-a84f-458a-95da-d91272678013 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:30.252511 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-72994123-a84f-458a-95da-d91272678013 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1508 microversion: 2.1 time: 0.168853 Jan 28 02:00:30.253111 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 324/641] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:30 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:30.911642 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:30.912160 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:30.918962 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:30.919363 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:30.920131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:30.920560 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:31.051871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:31.060565 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:31.062112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:31.063291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-49bdb5a0-35df-47e8-84e0-14a6d80a8610 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1795 microversion: 2.20 time: 0.155579 Jan 28 02:00:31.063857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 318/642] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:00:30 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1795 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:31.270394 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a38f7693-6163-48a4-8469-d9102980bfa2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.270999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a38f7693-6163-48a4-8469-d9102980bfa2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:31.277452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a38f7693-6163-48a4-8469-d9102980bfa2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:31.278446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a38f7693-6163-48a4-8469-d9102980bfa2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:31.279326 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a38f7693-6163-48a4-8469-d9102980bfa2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:31.279805 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a38f7693-6163-48a4-8469-d9102980bfa2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:31.420475 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a38f7693-6163-48a4-8469-d9102980bfa2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:31.428334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a38f7693-6163-48a4-8469-d9102980bfa2 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1508 microversion: 2.1 time: 0.161746 Jan 28 02:00:31.428997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 325/643] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:31.535154 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c9c7b08e-f321-41c1-ad0d-d98765239159 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f3bbca0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.598487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c9c7b08e-f321-41c1-ad0d-d98765239159 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/a5fc0457-3d11-44b3-a973-6195c650655a" status: 200 len: 350 microversion: 2.1 time: 0.067058 Jan 28 02:00:31.599062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 319/644] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/os-volumes/a5fc0457-3d11-44b3-a973-6195c650655a => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:31.610608 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5bcf7c30-2461-4bdb-b332-d15309041b3a tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f3c1550>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.693889 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5bcf7c30-2461-4bdb-b332-d15309041b3a tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087120 Jan 28 02:00:31.694598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 326/645] 10.222.0.96 () {58 vars in 1133 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:31.707962 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-458397e6-601d-4b3c-a9eb-4403ae68f4d0 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f3ec550>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.795376 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-458397e6-601d-4b3c-a9eb-4403ae68f4d0 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091028 Jan 28 02:00:31.796662 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 320/646] 10.222.0.96 () {58 vars in 1148 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:31.807372 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-aad8f360-c7d7-4e7b-a24a-fa3c90a5a1d1 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f40b790>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.898135 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-aad8f360-c7d7-4e7b-a24a-fa3c90a5a1d1 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094265 Jan 28 02:00:31.898707 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 327/647] 10.222.0.96 () {58 vars in 1133 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:31.910682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-54738b9d-1636-442b-9aeb-6142a7bf77d0 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f3af310>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.997164 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-54738b9d-1636-442b-9aeb-6142a7bf77d0 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090233 Jan 28 02:00:31.997736 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 321/648] 10.222.0.96 () {58 vars in 1166 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:32.010461 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-23a3d451-1c5f-4786-ac63-c4db40688e7e tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f390f70>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:32.092469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-23a3d451-1c5f-4786-ac63-c4db40688e7e tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086916 Jan 28 02:00:32.093072 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 328/649] 10.222.0.96 () {58 vars in 1169 bytes} [Fri Jan 28 02:00:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:00:32.104650 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bdc262f7-a905-4124-91e5-1357d54975ce tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523fd34790>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:32.189502 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bdc262f7-a905-4124-91e5-1357d54975ce tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088461 Jan 28 02:00:32.190340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 322/650] 10.222.0.96 () {58 vars in 1154 bytes} [Fri Jan 28 02:00:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:32.201728 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3bfd3aec-9c5f-482b-bd14-bb06ebfd32ba tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f390ca0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:32.283774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3bfd3aec-9c5f-482b-bd14-bb06ebfd32ba tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085554 Jan 28 02:00:32.284375 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 329/651] 10.222.0.96 () {58 vars in 1187 bytes} [Fri Jan 28 02:00:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:00:32.296157 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0cba69dd-0bec-4586-a005-22b8f8703bf8 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] Calling method '.version_select at 0x7f523f3ecb80>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:32.377300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0cba69dd-0bec-4586-a005-22b8f8703bf8 tempest-VolumesTestJSON-2147453163 tempest-VolumesTestJSON-2147453163-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085243 Jan 28 02:00:32.378131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 323/652] 10.222.0.96 () {58 vars in 1154 bytes} [Fri Jan 28 02:00:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:32.448434 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e747bcc9-8f17-4d1a-b899-33a3996de45c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:32.448434 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e747bcc9-8f17-4d1a-b899-33a3996de45c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:32.456229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e747bcc9-8f17-4d1a-b899-33a3996de45c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:32.456870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e747bcc9-8f17-4d1a-b899-33a3996de45c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:32.457784 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e747bcc9-8f17-4d1a-b899-33a3996de45c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:32.458294 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e747bcc9-8f17-4d1a-b899-33a3996de45c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:32.677329 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e747bcc9-8f17-4d1a-b899-33a3996de45c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:32.685717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e747bcc9-8f17-4d1a-b899-33a3996de45c tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 200 len: 1508 microversion: 2.1 time: 0.242873 Jan 28 02:00:32.686502 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 330/653] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:32 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:32.888972 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-13dfab23-57b9-4557-92fa-a80b4e675da3 req-7537f2d1-747c-4d29-a027-5d0941d7e17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d2d895-fbb9-418c-a29a-6988b3992d10", "name": "network-vif-deleted", "tag": "1139f116-1935-408c-a5bf-876a9f0d0365"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:32.890530 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:32.890530 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:00:32.899749 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-13dfab23-57b9-4557-92fa-a80b4e675da3 req-7537f2d1-747c-4d29-a027-5d0941d7e17f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:32.900219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-13dfab23-57b9-4557-92fa-a80b4e675da3 req-7537f2d1-747c-4d29-a027-5d0941d7e17f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:32.912925 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-13dfab23-57b9-4557-92fa-a80b4e675da3 req-7537f2d1-747c-4d29-a027-5d0941d7e17f service nova] Creating event network-vif-deleted:1139f116-1935-408c-a5bf-876a9f0d0365 for instance c4d2d895-fbb9-418c-a29a-6988b3992d10 on hv-cinder-82497 Jan 28 02:00:32.920377 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-13dfab23-57b9-4557-92fa-a80b4e675da3 req-7537f2d1-747c-4d29-a027-5d0941d7e17f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033213 Jan 28 02:00:32.920377 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 324/654] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:33.702348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:33.702961 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: c4d2d895-fbb9-418c-a29a-6988b3992d10] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:33.708841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:33.709299 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:33.710073 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:33.710542 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:33.725039 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] HTTP exception thrown: Instance c4d2d895-fbb9-418c-a29a-6988b3992d10 could not be found. Jan 28 02:00:33.725532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Returning 404 to user: Instance c4d2d895-fbb9-418c-a29a-6988b3992d10 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:00:33.726410 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-24331f6f-1e06-4b3f-9d6d-4ab8b6749dd6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10" status: 404 len: 111 microversion: 2.1 time: 0.027926 Jan 28 02:00:33.726961 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 331/655] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:33 2022] GET /compute/v2.1/servers/c4d2d895-fbb9-418c-a29a-6988b3992d10 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:00:33.736051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0089ff23-0f9a-4d56-bd77-8e030e1900ea tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:33.736636 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0089ff23-0f9a-4d56-bd77-8e030e1900ea tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:33.747350 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0089ff23-0f9a-4d56-bd77-8e030e1900ea tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:33.747801 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0089ff23-0f9a-4d56-bd77-8e030e1900ea tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:33.748587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0089ff23-0f9a-4d56-bd77-8e030e1900ea tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:33.749060 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0089ff23-0f9a-4d56-bd77-8e030e1900ea tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:33.775612 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0089ff23-0f9a-4d56-bd77-8e030e1900ea tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:00:33.861301 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0089ff23-0f9a-4d56-bd77-8e030e1900ea tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "DELETE /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 204 len: 0 microversion: 2.1 time: 0.128746 Jan 28 02:00:33.862093 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 325/656] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:00:33 2022] DELETE /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:00:33.878844 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-11b53c16-ddbe-4ff3-a1fd-5c104a1954d6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:33.879461 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-11b53c16-ddbe-4ff3-a1fd-5c104a1954d6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:33.885285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11b53c16-ddbe-4ff3-a1fd-5c104a1954d6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:33.885736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11b53c16-ddbe-4ff3-a1fd-5c104a1954d6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:33.886640 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11b53c16-ddbe-4ff3-a1fd-5c104a1954d6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:33.887451 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11b53c16-ddbe-4ff3-a1fd-5c104a1954d6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:34.013959 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-11b53c16-ddbe-4ff3-a1fd-5c104a1954d6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:34.021380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-11b53c16-ddbe-4ff3-a1fd-5c104a1954d6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.154765 Jan 28 02:00:34.021945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 332/657] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:33 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:35.040076 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7ab639b8-b6b3-4f44-9bae-93eff956109e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:35.040695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7ab639b8-b6b3-4f44-9bae-93eff956109e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:35.047211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ab639b8-b6b3-4f44-9bae-93eff956109e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:35.047666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ab639b8-b6b3-4f44-9bae-93eff956109e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:35.048468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ab639b8-b6b3-4f44-9bae-93eff956109e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:35.048928 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ab639b8-b6b3-4f44-9bae-93eff956109e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:35.178796 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7ab639b8-b6b3-4f44-9bae-93eff956109e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:35.187544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7ab639b8-b6b3-4f44-9bae-93eff956109e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.150237 Jan 28 02:00:35.187544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 326/658] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:35 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:36.204205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f93b9c1a-d622-4f6d-89b2-6797d0932f80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:36.204873 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f93b9c1a-d622-4f6d-89b2-6797d0932f80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:36.210861 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f93b9c1a-d622-4f6d-89b2-6797d0932f80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:36.211308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f93b9c1a-d622-4f6d-89b2-6797d0932f80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:36.212101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f93b9c1a-d622-4f6d-89b2-6797d0932f80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:36.212538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f93b9c1a-d622-4f6d-89b2-6797d0932f80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:36.401221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f93b9c1a-d622-4f6d-89b2-6797d0932f80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:36.409385 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f93b9c1a-d622-4f6d-89b2-6797d0932f80 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.209071 Jan 28 02:00:36.409957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 333/659] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:36 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:37.426975 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5b0953f1-dea9-4b6f-9031-efbad3e8a37f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:37.427551 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5b0953f1-dea9-4b6f-9031-efbad3e8a37f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:37.433990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5b0953f1-dea9-4b6f-9031-efbad3e8a37f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:37.434434 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5b0953f1-dea9-4b6f-9031-efbad3e8a37f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:37.435196 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5b0953f1-dea9-4b6f-9031-efbad3e8a37f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:37.435626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5b0953f1-dea9-4b6f-9031-efbad3e8a37f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:37.568573 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5b0953f1-dea9-4b6f-9031-efbad3e8a37f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:37.586166 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5b0953f1-dea9-4b6f-9031-efbad3e8a37f tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.162691 Jan 28 02:00:37.587043 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 327/660] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:37 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:38.102841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-aa77692f-1910-40ad-b6e8-3405a088e85a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e88a20ba-30eb-447a-a2e0-b4f4fc2227ef", "device": "/dev/sdb"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:38.105614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-aa77692f-1910-40ad-b6e8-3405a088e85a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:38.111764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aa77692f-1910-40ad-b6e8-3405a088e85a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:38.112213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aa77692f-1910-40ad-b6e8-3405a088e85a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:38.113015 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aa77692f-1910-40ad-b6e8-3405a088e85a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:38.113446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aa77692f-1910-40ad-b6e8-3405a088e85a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:38.373679 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-aa77692f-1910-40ad-b6e8-3405a088e85a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "POST /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274569 Jan 28 02:00:38.374290 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 334/661] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 02:00:38 2022] POST /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:38.604587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-329c6ade-29fc-424a-b8a1-84b9d67c2605 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:38.605900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-329c6ade-29fc-424a-b8a1-84b9d67c2605 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:38.611919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-329c6ade-29fc-424a-b8a1-84b9d67c2605 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:38.612473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-329c6ade-29fc-424a-b8a1-84b9d67c2605 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:38.613284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-329c6ade-29fc-424a-b8a1-84b9d67c2605 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:38.613730 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-329c6ade-29fc-424a-b8a1-84b9d67c2605 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:38.739703 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-329c6ade-29fc-424a-b8a1-84b9d67c2605 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:38.747574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-329c6ade-29fc-424a-b8a1-84b9d67c2605 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.146688 Jan 28 02:00:38.748142 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 328/662] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:38 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:39.764698 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e74af335-b5f4-4c07-8689-576e81ecb036 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:39.765419 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e74af335-b5f4-4c07-8689-576e81ecb036 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:39.772482 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e74af335-b5f4-4c07-8689-576e81ecb036 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:39.772977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e74af335-b5f4-4c07-8689-576e81ecb036 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:39.773751 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e74af335-b5f4-4c07-8689-576e81ecb036 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:39.774190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e74af335-b5f4-4c07-8689-576e81ecb036 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:39.914898 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e74af335-b5f4-4c07-8689-576e81ecb036 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:39.923450 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e74af335-b5f4-4c07-8689-576e81ecb036 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.163506 Jan 28 02:00:39.924035 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 335/663] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:39 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:40.939460 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-60926c10-0256-426a-be25-7e63426c2a2e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:40.940128 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-60926c10-0256-426a-be25-7e63426c2a2e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:40.946098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60926c10-0256-426a-be25-7e63426c2a2e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:40.946549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60926c10-0256-426a-be25-7e63426c2a2e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:40.947317 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60926c10-0256-426a-be25-7e63426c2a2e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:40.947749 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60926c10-0256-426a-be25-7e63426c2a2e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:41.069948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-60926c10-0256-426a-be25-7e63426c2a2e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:41.078244 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-60926c10-0256-426a-be25-7e63426c2a2e tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.142449 Jan 28 02:00:41.078812 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 329/664] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:40 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:42.095544 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d86505e8-b887-4682-8c7f-fbba5de9a865 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:42.096151 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d86505e8-b887-4682-8c7f-fbba5de9a865 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:42.102449 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d86505e8-b887-4682-8c7f-fbba5de9a865 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:42.102898 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d86505e8-b887-4682-8c7f-fbba5de9a865 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:42.103666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d86505e8-b887-4682-8c7f-fbba5de9a865 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:42.104107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d86505e8-b887-4682-8c7f-fbba5de9a865 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:42.240759 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d86505e8-b887-4682-8c7f-fbba5de9a865 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:42.249346 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d86505e8-b887-4682-8c7f-fbba5de9a865 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.157357 Jan 28 02:00:42.249917 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 336/665] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:42 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:43.267162 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-db12924c-6668-4fd2-8d0e-fd333c465c6d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:43.267784 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-db12924c-6668-4fd2-8d0e-fd333c465c6d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:43.273893 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db12924c-6668-4fd2-8d0e-fd333c465c6d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:43.274348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db12924c-6668-4fd2-8d0e-fd333c465c6d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:43.275139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db12924c-6668-4fd2-8d0e-fd333c465c6d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:43.275578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db12924c-6668-4fd2-8d0e-fd333c465c6d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:43.400129 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-db12924c-6668-4fd2-8d0e-fd333c465c6d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:43.407897 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-db12924c-6668-4fd2-8d0e-fd333c465c6d tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1522 microversion: 2.1 time: 0.144425 Jan 28 02:00:43.408480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 330/666] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:43 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:44.424319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-32145cb7-2697-4c9e-b876-bd1548976ca6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:44.425086 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-32145cb7-2697-4c9e-b876-bd1548976ca6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:44.430861 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32145cb7-2697-4c9e-b876-bd1548976ca6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:44.431308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32145cb7-2697-4c9e-b876-bd1548976ca6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:44.432081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32145cb7-2697-4c9e-b876-bd1548976ca6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:44.432512 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32145cb7-2697-4c9e-b876-bd1548976ca6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:44.480839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-53edd050-4bf1-46d3-bcbf-86343e98edcf req-5c9d6e2c-8d1c-4d56-8f5a-4ccced1c7ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c", "name": "network-vif-deleted", "tag": "4589897f-4d9d-4d78-97c1-85b8537fd56d"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:44.482621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:00:44.482621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:00:44.490844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-53edd050-4bf1-46d3-bcbf-86343e98edcf req-5c9d6e2c-8d1c-4d56-8f5a-4ccced1c7ced service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:44.491318 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-53edd050-4bf1-46d3-bcbf-86343e98edcf req-5c9d6e2c-8d1c-4d56-8f5a-4ccced1c7ced service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:44.503094 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-53edd050-4bf1-46d3-bcbf-86343e98edcf req-5c9d6e2c-8d1c-4d56-8f5a-4ccced1c7ced service nova] Creating event network-vif-deleted:4589897f-4d9d-4d78-97c1-85b8537fd56d for instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c on hv-cinder-82497 Jan 28 02:00:44.509381 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-53edd050-4bf1-46d3-bcbf-86343e98edcf req-5c9d6e2c-8d1c-4d56-8f5a-4ccced1c7ced service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032045 Jan 28 02:00:44.509783 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-32145cb7-2697-4c9e-b876-bd1548976ca6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8f259580b84c1da7ccd7dd9391e406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:44.510833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 331/667] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:00:44.519659 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-32145cb7-2697-4c9e-b876-bd1548976ca6 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 200 len: 1480 microversion: 2.1 time: 0.099019 Jan 28 02:00:44.520251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 337/668] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:44 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 1480 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:45.538216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:45.538919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] [instance: d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:45.545048 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:45.545508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:45.546291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:45.546739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:45.561242 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] HTTP exception thrown: Instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c could not be found. Jan 28 02:00:45.561839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] Returning 404 to user: Instance d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:00:45.562671 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6595284a-93ac-4a7e-b107-149baf9c6cf3 tempest-ServerRescueNegativeTestJSON-1011151844 tempest-ServerRescueNegativeTestJSON-1011151844-project] 10.222.0.96 "GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c" status: 404 len: 111 microversion: 2.1 time: 0.028502 Jan 28 02:00:45.563231 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 332/669] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:45 2022] GET /compute/v2.1/servers/d938ffb5-4eb6-4ae0-ba2f-87132eb9ad2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:00:54.313686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dde4f863-1ec9-441b-8c2f-af5df7005f1e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'create', calling method: .version_select at 0x7f523f3c1430>, body: {"keypair": {"name": "tempest-keypair-408111758"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:54.341355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-dde4f863-1ec9-441b-8c2f-af5df7005f1e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for project a20883c8bb00403490e966953c48afa7. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:00:54.345511 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-dde4f863-1ec9-441b-8c2f-af5df7005f1e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for user cb4b6e4c21f34cbd8d89686ce74fe07a and project a20883c8bb00403490e966953c48afa7. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:00:54.503680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-dde4f863-1ec9-441b-8c2f-af5df7005f1e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for project a20883c8bb00403490e966953c48afa7. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:00:54.508393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-dde4f863-1ec9-441b-8c2f-af5df7005f1e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for user cb4b6e4c21f34cbd8d89686ce74fe07a and project a20883c8bb00403490e966953c48afa7. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:00:54.530645 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dde4f863-1ec9-441b-8c2f-af5df7005f1e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.345057 Jan 28 02:00:54.531254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 338/670] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Jan 28 02:00:54 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:55.957270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-624971346", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcd5597a-b815-4400-9cef-79a66efeb499"}], "security_groups": [{"name": "tempest-securitygroup--594404787"}], "key_name": "tempest-keypair-408111758", "user_data": "}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:00:56.061760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] validate_networks() for [('fcd5597a-b815-4400-9cef-79a66efeb499', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:00:56.451313 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:00:56.452075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:00:56.453130 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:00:56.453889 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:00:56.454423 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:00:56.467580 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:56.468358 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:56.469819 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:56.470591 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:56.502299 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for project a20883c8bb00403490e966953c48afa7. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:00:56.509495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for user cb4b6e4c21f34cbd8d89686ce74fe07a and project a20883c8bb00403490e966953c48afa7. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:00:56.521786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:00:56.524127 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:00:56.574592 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bbf68ef4-1325-40d4-8d1d-d513e56a0cf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621642 Jan 28 02:00:56.580887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 333/671] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 02:00:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:00:56.586361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d7a2c752-8760-4e95-978d-2dc6e5e0ef7f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:56.587335 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d7a2c752-8760-4e95-978d-2dc6e5e0ef7f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:56.649075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d7a2c752-8760-4e95-978d-2dc6e5e0ef7f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:56.657643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d7a2c752-8760-4e95-978d-2dc6e5e0ef7f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1236 microversion: 2.1 time: 0.075723 Jan 28 02:00:56.658206 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 339/672] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:56 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:57.676448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1151a104-94f4-4ba1-8672-19192fb93128 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:57.684389 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1151a104-94f4-4ba1-8672-19192fb93128 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:57.692171 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1151a104-94f4-4ba1-8672-19192fb93128 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:57.693035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1151a104-94f4-4ba1-8672-19192fb93128 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:57.694249 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1151a104-94f4-4ba1-8672-19192fb93128 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:57.695179 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1151a104-94f4-4ba1-8672-19192fb93128 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:57.793513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1151a104-94f4-4ba1-8672-19192fb93128 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:57.802431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1151a104-94f4-4ba1-8672-19192fb93128 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1240 microversion: 2.1 time: 0.131644 Jan 28 02:00:57.803020 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 334/673] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:57 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1240 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:58.819941 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9a892774-1bd2-402d-8692-795264da1ebe tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:58.820557 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9a892774-1bd2-402d-8692-795264da1ebe tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:58.827723 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a892774-1bd2-402d-8692-795264da1ebe tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:58.829821 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a892774-1bd2-402d-8692-795264da1ebe tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:58.831386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a892774-1bd2-402d-8692-795264da1ebe tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:58.832049 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a892774-1bd2-402d-8692-795264da1ebe tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:58.924779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9a892774-1bd2-402d-8692-795264da1ebe tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:00:58.932343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9a892774-1bd2-402d-8692-795264da1ebe tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1294 microversion: 2.1 time: 0.116760 Jan 28 02:00:58.934390 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 340/674] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:58 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1294 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:59.950979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cb04f6ba-8836-4efa-8a8c-cc26e572c422 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:59.951625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cb04f6ba-8836-4efa-8a8c-cc26e572c422 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:00:59.957479 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb04f6ba-8836-4efa-8a8c-cc26e572c422 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:59.957933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb04f6ba-8836-4efa-8a8c-cc26e572c422 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:00:59.958750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb04f6ba-8836-4efa-8a8c-cc26e572c422 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:00:59.959191 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb04f6ba-8836-4efa-8a8c-cc26e572c422 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:00.208495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cb04f6ba-8836-4efa-8a8c-cc26e572c422 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:00.216777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cb04f6ba-8836-4efa-8a8c-cc26e572c422 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.270135 Jan 28 02:01:00.217388 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 335/675] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:00:59 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:00.377556 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-119edbfe-9884-4dd9-a325-1f5ef23ae8e9 req-8c0a4b21-7edc-4c8a-ae22-9d459e31b87d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3", "tag": "29b6b39c-b993-4f94-9cd1-2d095d6ea243"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:00.379230 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:00.379230 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:01:00.387510 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-119edbfe-9884-4dd9-a325-1f5ef23ae8e9 req-8c0a4b21-7edc-4c8a-ae22-9d459e31b87d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:00.387975 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-119edbfe-9884-4dd9-a325-1f5ef23ae8e9 req-8c0a4b21-7edc-4c8a-ae22-9d459e31b87d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:00.405427 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-119edbfe-9884-4dd9-a325-1f5ef23ae8e9 req-8c0a4b21-7edc-4c8a-ae22-9d459e31b87d service nova] Creating event network-changed:29b6b39c-b993-4f94-9cd1-2d095d6ea243 for instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 on hv-cinder-82497 Jan 28 02:01:00.411275 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-119edbfe-9884-4dd9-a325-1f5ef23ae8e9 req-8c0a4b21-7edc-4c8a-ae22-9d459e31b87d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037271 Jan 28 02:01:00.412216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 341/676] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:01.234467 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d478e4bf-5b34-4845-9cc4-8123c0c245a2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:01.235716 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d478e4bf-5b34-4845-9cc4-8123c0c245a2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:01.241649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d478e4bf-5b34-4845-9cc4-8123c0c245a2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:01.242097 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d478e4bf-5b34-4845-9cc4-8123c0c245a2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:01.242877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d478e4bf-5b34-4845-9cc4-8123c0c245a2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:01.243311 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d478e4bf-5b34-4845-9cc4-8123c0c245a2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:01.458827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d478e4bf-5b34-4845-9cc4-8123c0c245a2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:01.469561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d478e4bf-5b34-4845-9cc4-8123c0c245a2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.238806 Jan 28 02:01:01.470222 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 336/677] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:01 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:02.186156 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5e5d69ea-0c2d-486d-b3e3-2c9477e4a277 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:02.186676 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5e5d69ea-0c2d-486d-b3e3-2c9477e4a277 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:02.193539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e5d69ea-0c2d-486d-b3e3-2c9477e4a277 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:02.193980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e5d69ea-0c2d-486d-b3e3-2c9477e4a277 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:02.194755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e5d69ea-0c2d-486d-b3e3-2c9477e4a277 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:02.195181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e5d69ea-0c2d-486d-b3e3-2c9477e4a277 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:02.281811 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-5e5d69ea-0c2d-486d-b3e3-2c9477e4a277 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lazy-loading 'services' on Instance uuid 367b6b36-483a-4cc8-b26a-2921068ed175 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:01:02.346267 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5e5d69ea-0c2d-486d-b3e3-2c9477e4a277 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "DELETE /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175/os-volume_attachments/e88a20ba-30eb-447a-a2e0-b4f4fc2227ef" status: 202 len: 0 microversion: 2.1 time: 0.164670 Jan 28 02:01:02.346886 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 342/678] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:01:02 2022] DELETE /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175/os-volume_attachments/e88a20ba-30eb-447a-a2e0-b4f4fc2227ef => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:01:02.487245 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c01ba1a9-9fba-41dd-b6ee-b897dcfc36c2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:02.487855 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c01ba1a9-9fba-41dd-b6ee-b897dcfc36c2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:02.493839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c01ba1a9-9fba-41dd-b6ee-b897dcfc36c2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:02.494291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c01ba1a9-9fba-41dd-b6ee-b897dcfc36c2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:02.495065 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c01ba1a9-9fba-41dd-b6ee-b897dcfc36c2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:02.496097 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c01ba1a9-9fba-41dd-b6ee-b897dcfc36c2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:02.633467 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c01ba1a9-9fba-41dd-b6ee-b897dcfc36c2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:02.641472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c01ba1a9-9fba-41dd-b6ee-b897dcfc36c2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.157857 Jan 28 02:01:02.642055 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 337/679] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:02 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:03.476560 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e93f7ff8-3ba9-4523-b3d6-0521c0024fa0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:03.477198 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e93f7ff8-3ba9-4523-b3d6-0521c0024fa0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:03.483575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e93f7ff8-3ba9-4523-b3d6-0521c0024fa0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:03.484072 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e93f7ff8-3ba9-4523-b3d6-0521c0024fa0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:03.485076 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e93f7ff8-3ba9-4523-b3d6-0521c0024fa0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:03.485605 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e93f7ff8-3ba9-4523-b3d6-0521c0024fa0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:03.511849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e93f7ff8-3ba9-4523-b3d6-0521c0024fa0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:01:03.592234 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e93f7ff8-3ba9-4523-b3d6-0521c0024fa0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "DELETE /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 204 len: 0 microversion: 2.1 time: 0.119472 Jan 28 02:01:03.592860 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 343/680] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:01:03 2022] DELETE /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:01:03.600672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f05d7d1-5f36-4de3-8e04-64e8d2561f8e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:03.601319 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f05d7d1-5f36-4de3-8e04-64e8d2561f8e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:03.608516 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f05d7d1-5f36-4de3-8e04-64e8d2561f8e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:03.608997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f05d7d1-5f36-4de3-8e04-64e8d2561f8e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:03.609850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f05d7d1-5f36-4de3-8e04-64e8d2561f8e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:03.610290 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f05d7d1-5f36-4de3-8e04-64e8d2561f8e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:03.661317 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-84c3e096-f8ac-49d7-b5ea-ac678f9f6ded tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:03.661650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-84c3e096-f8ac-49d7-b5ea-ac678f9f6ded tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:03.668971 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-84c3e096-f8ac-49d7-b5ea-ac678f9f6ded tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:03.669482 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-84c3e096-f8ac-49d7-b5ea-ac678f9f6ded tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:03.670285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-84c3e096-f8ac-49d7-b5ea-ac678f9f6ded tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:03.670763 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-84c3e096-f8ac-49d7-b5ea-ac678f9f6ded tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:03.770264 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f05d7d1-5f36-4de3-8e04-64e8d2561f8e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:03.778788 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2f05d7d1-5f36-4de3-8e04-64e8d2561f8e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1512 microversion: 2.1 time: 0.181394 Jan 28 02:01:03.780190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 338/681] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:03 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:03.835597 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-84c3e096-f8ac-49d7-b5ea-ac678f9f6ded tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:03.843279 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-84c3e096-f8ac-49d7-b5ea-ac678f9f6ded tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.187841 Jan 28 02:01:03.853346 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 344/682] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:03 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:04.795513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dfb68cb4-b660-4d20-b42d-eaefc891ac15 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:04.796129 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dfb68cb4-b660-4d20-b42d-eaefc891ac15 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:04.802152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dfb68cb4-b660-4d20-b42d-eaefc891ac15 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:04.802604 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dfb68cb4-b660-4d20-b42d-eaefc891ac15 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:04.803386 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dfb68cb4-b660-4d20-b42d-eaefc891ac15 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:04.803816 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dfb68cb4-b660-4d20-b42d-eaefc891ac15 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:04.859626 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-37c44e34-efff-424d-be9b-6129841965fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:04.860237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-37c44e34-efff-424d-be9b-6129841965fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:04.866820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37c44e34-efff-424d-be9b-6129841965fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:04.867030 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37c44e34-efff-424d-be9b-6129841965fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:04.867771 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37c44e34-efff-424d-be9b-6129841965fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:04.868223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37c44e34-efff-424d-be9b-6129841965fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:04.962590 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dfb68cb4-b660-4d20-b42d-eaefc891ac15 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:04.977676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dfb68cb4-b660-4d20-b42d-eaefc891ac15 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1512 microversion: 2.1 time: 0.185818 Jan 28 02:01:04.978260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 339/683] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:04 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:05.023358 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-37c44e34-efff-424d-be9b-6129841965fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:05.032652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-37c44e34-efff-424d-be9b-6129841965fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.176604 Jan 28 02:01:05.033265 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 345/684] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:04 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:05.996065 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0a80695e-93d2-410d-ba56-1de2995a16b5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:05.996769 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0a80695e-93d2-410d-ba56-1de2995a16b5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:06.002647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0a80695e-93d2-410d-ba56-1de2995a16b5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:06.003100 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0a80695e-93d2-410d-ba56-1de2995a16b5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:06.003884 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0a80695e-93d2-410d-ba56-1de2995a16b5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:06.004323 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0a80695e-93d2-410d-ba56-1de2995a16b5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:06.049534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8cd03233-850d-4111-907b-acbc46d755e3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:06.050147 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8cd03233-850d-4111-907b-acbc46d755e3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:06.056053 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cd03233-850d-4111-907b-acbc46d755e3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:06.056501 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cd03233-850d-4111-907b-acbc46d755e3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:06.057292 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cd03233-850d-4111-907b-acbc46d755e3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:06.058236 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cd03233-850d-4111-907b-acbc46d755e3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:06.164746 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0a80695e-93d2-410d-ba56-1de2995a16b5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:06.172383 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0a80695e-93d2-410d-ba56-1de2995a16b5 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1512 microversion: 2.1 time: 0.180637 Jan 28 02:01:06.172991 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 340/685] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:05 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:06.215780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8cd03233-850d-4111-907b-acbc46d755e3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:06.223133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8cd03233-850d-4111-907b-acbc46d755e3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.177283 Jan 28 02:01:06.223699 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 346/686] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:06 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:07.189091 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3eaa0d36-de9c-47da-b41e-d2136ae93308 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:07.189732 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3eaa0d36-de9c-47da-b41e-d2136ae93308 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:07.195583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3eaa0d36-de9c-47da-b41e-d2136ae93308 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:07.196031 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3eaa0d36-de9c-47da-b41e-d2136ae93308 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:07.196818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3eaa0d36-de9c-47da-b41e-d2136ae93308 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:07.197262 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3eaa0d36-de9c-47da-b41e-d2136ae93308 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:07.239361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6ddda4ed-34ab-4b2a-8979-b89b2ff2acb3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:07.239970 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6ddda4ed-34ab-4b2a-8979-b89b2ff2acb3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:07.246056 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ddda4ed-34ab-4b2a-8979-b89b2ff2acb3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:07.246499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ddda4ed-34ab-4b2a-8979-b89b2ff2acb3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:07.247419 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ddda4ed-34ab-4b2a-8979-b89b2ff2acb3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:07.247857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ddda4ed-34ab-4b2a-8979-b89b2ff2acb3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:07.366127 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3eaa0d36-de9c-47da-b41e-d2136ae93308 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:07.376217 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3eaa0d36-de9c-47da-b41e-d2136ae93308 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1512 microversion: 2.1 time: 0.190611 Jan 28 02:01:07.376971 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 341/687] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:07 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:07.391116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-bb90e869-0903-4cd7-a9c5-ccef6c499519 req-ddf6bfc8-be9c-486f-94bc-7d453fc501c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3", "name": "network-vif-plugged", "status": "completed", "tag": "29b6b39c-b993-4f94-9cd1-2d095d6ea243"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:07.392703 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:07.392703 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:01:07.399555 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-bb90e869-0903-4cd7-a9c5-ccef6c499519 req-ddf6bfc8-be9c-486f-94bc-7d453fc501c2 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:07.400238 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-bb90e869-0903-4cd7-a9c5-ccef6c499519 req-ddf6bfc8-be9c-486f-94bc-7d453fc501c2 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:07.416380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-bb90e869-0903-4cd7-a9c5-ccef6c499519 req-ddf6bfc8-be9c-486f-94bc-7d453fc501c2 service nova] Creating event network-vif-plugged:29b6b39c-b993-4f94-9cd1-2d095d6ea243 for instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 on hv-cinder-82497 Jan 28 02:01:07.422144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-bb90e869-0903-4cd7-a9c5-ccef6c499519 req-ddf6bfc8-be9c-486f-94bc-7d453fc501c2 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034683 Jan 28 02:01:07.422770 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 342/688] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:07.424823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6ddda4ed-34ab-4b2a-8979-b89b2ff2acb3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:07.433276 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6ddda4ed-34ab-4b2a-8979-b89b2ff2acb3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.196856 Jan 28 02:01:07.433851 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 347/689] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:07 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:08.397959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7bd750d9-804f-4355-8fca-e12dac263f87 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:08.398654 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7bd750d9-804f-4355-8fca-e12dac263f87 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:08.406354 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7bd750d9-804f-4355-8fca-e12dac263f87 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:08.406817 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7bd750d9-804f-4355-8fca-e12dac263f87 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:08.407887 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7bd750d9-804f-4355-8fca-e12dac263f87 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:08.408674 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7bd750d9-804f-4355-8fca-e12dac263f87 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:08.451253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d3dcf50c-281d-49d0-868a-f643ae899d7c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:08.452015 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d3dcf50c-281d-49d0-868a-f643ae899d7c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:08.460114 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d3dcf50c-281d-49d0-868a-f643ae899d7c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:08.460697 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d3dcf50c-281d-49d0-868a-f643ae899d7c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:08.461666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d3dcf50c-281d-49d0-868a-f643ae899d7c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:08.462169 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d3dcf50c-281d-49d0-868a-f643ae899d7c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:08.655835 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7bd750d9-804f-4355-8fca-e12dac263f87 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:08.663848 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7bd750d9-804f-4355-8fca-e12dac263f87 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1512 microversion: 2.1 time: 0.273485 Jan 28 02:01:08.664438 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 343/690] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:08 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:08.664632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d3dcf50c-281d-49d0-868a-f643ae899d7c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:08.673122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d3dcf50c-281d-49d0-868a-f643ae899d7c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.226594 Jan 28 02:01:08.673700 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 348/691] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:08 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:09.682401 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-171a891d-1583-4d8a-ac50-d5a875e38027 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:09.683492 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-171a891d-1583-4d8a-ac50-d5a875e38027 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:09.689898 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5438c868-5a29-4799-b2b4-5b6c9d5cba82 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:09.690380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-171a891d-1583-4d8a-ac50-d5a875e38027 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:09.690380 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-171a891d-1583-4d8a-ac50-d5a875e38027 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:09.690718 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5438c868-5a29-4799-b2b4-5b6c9d5cba82 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:09.691175 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-171a891d-1583-4d8a-ac50-d5a875e38027 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:09.691659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-171a891d-1583-4d8a-ac50-d5a875e38027 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:09.696120 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5438c868-5a29-4799-b2b4-5b6c9d5cba82 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:09.696570 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5438c868-5a29-4799-b2b4-5b6c9d5cba82 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:09.697382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5438c868-5a29-4799-b2b4-5b6c9d5cba82 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:09.697818 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5438c868-5a29-4799-b2b4-5b6c9d5cba82 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:09.874835 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-171a891d-1583-4d8a-ac50-d5a875e38027 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:09.882270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-171a891d-1583-4d8a-ac50-d5a875e38027 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1512 microversion: 2.1 time: 0.203572 Jan 28 02:01:09.882580 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5438c868-5a29-4799-b2b4-5b6c9d5cba82 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:09.882846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 344/692] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:09 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:09.891020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5438c868-5a29-4799-b2b4-5b6c9d5cba82 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.204823 Jan 28 02:01:09.891690 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 349/693] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:09 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:10.900124 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fad89164-abee-4fdc-8349-584fa33ee790 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:10.900727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fad89164-abee-4fdc-8349-584fa33ee790 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:10.908714 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fad89164-abee-4fdc-8349-584fa33ee790 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:10.908926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a9f82dce-6057-47c4-878f-bb926c207408 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:10.909372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fad89164-abee-4fdc-8349-584fa33ee790 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:10.909547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a9f82dce-6057-47c4-878f-bb926c207408 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:10.909948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fad89164-abee-4fdc-8349-584fa33ee790 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:10.910379 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fad89164-abee-4fdc-8349-584fa33ee790 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:10.915863 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9f82dce-6057-47c4-878f-bb926c207408 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:10.916340 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9f82dce-6057-47c4-878f-bb926c207408 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:10.917957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9f82dce-6057-47c4-878f-bb926c207408 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:10.918421 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9f82dce-6057-47c4-878f-bb926c207408 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:11.090322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fad89164-abee-4fdc-8349-584fa33ee790 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:11.093717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a9f82dce-6057-47c4-878f-bb926c207408 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:11.101159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a9f82dce-6057-47c4-878f-bb926c207408 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.195802 Jan 28 02:01:11.101722 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 350/694] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:10 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:11.103639 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fad89164-abee-4fdc-8349-584fa33ee790 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1512 microversion: 2.1 time: 0.206805 Jan 28 02:01:11.104693 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 345/695] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:10 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:12.119805 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-aef37081-f1f3-4e9b-867f-12e028a845e6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:12.120993 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-aef37081-f1f3-4e9b-867f-12e028a845e6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:12.121385 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3c45302f-77d7-4310-9b7c-e827f49d531e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:12.122000 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3c45302f-77d7-4310-9b7c-e827f49d531e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:12.127660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aef37081-f1f3-4e9b-867f-12e028a845e6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:12.128115 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aef37081-f1f3-4e9b-867f-12e028a845e6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:12.129103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aef37081-f1f3-4e9b-867f-12e028a845e6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:12.129538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aef37081-f1f3-4e9b-867f-12e028a845e6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:12.134786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c45302f-77d7-4310-9b7c-e827f49d531e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:12.135232 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c45302f-77d7-4310-9b7c-e827f49d531e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:12.137682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c45302f-77d7-4310-9b7c-e827f49d531e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:12.137682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c45302f-77d7-4310-9b7c-e827f49d531e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:12.233025 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3c45302f-77d7-4310-9b7c-e827f49d531e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:12.240908 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3c45302f-77d7-4310-9b7c-e827f49d531e tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 200 len: 1470 microversion: 2.1 time: 0.122991 Jan 28 02:01:12.241891 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 346/696] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:12 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 1470 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:12.246615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-e7eb0063-c094-4616-aa8f-862acc83ad34 req-8fd09049-7f57-4dd4-8300-def437da61a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367b6b36-483a-4cc8-b26a-2921068ed175", "name": "network-vif-deleted", "tag": "8cd36e81-1c02-4dd4-9de3-3cdce47bb04a"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:12.248657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:12.248657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:01:12.256313 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-e7eb0063-c094-4616-aa8f-862acc83ad34 req-8fd09049-7f57-4dd4-8300-def437da61a4 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:12.256763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-e7eb0063-c094-4616-aa8f-862acc83ad34 req-8fd09049-7f57-4dd4-8300-def437da61a4 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:12.271664 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-e7eb0063-c094-4616-aa8f-862acc83ad34 req-8fd09049-7f57-4dd4-8300-def437da61a4 service nova] Creating event network-vif-deleted:8cd36e81-1c02-4dd4-9de3-3cdce47bb04a for instance 367b6b36-483a-4cc8-b26a-2921068ed175 on hv-cinder-82497 Jan 28 02:01:12.279367 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-e7eb0063-c094-4616-aa8f-862acc83ad34 req-8fd09049-7f57-4dd4-8300-def437da61a4 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035867 Jan 28 02:01:12.279962 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 347/697] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:12.300873 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-aef37081-f1f3-4e9b-867f-12e028a845e6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:12.309007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-aef37081-f1f3-4e9b-867f-12e028a845e6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1361 microversion: 2.1 time: 0.194719 Jan 28 02:01:12.309577 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 351/698] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:12 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:13.259557 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:13.260293 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 367b6b36-483a-4cc8-b26a-2921068ed175] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:13.267657 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:13.268100 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:13.268935 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:13.269658 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:13.284575 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] HTTP exception thrown: Instance 367b6b36-483a-4cc8-b26a-2921068ed175 could not be found. Jan 28 02:01:13.285275 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Returning 404 to user: Instance 367b6b36-483a-4cc8-b26a-2921068ed175 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:01:13.286113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e95394a2-bf43-44b8-8082-78c787f06971 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175" status: 404 len: 111 microversion: 2.1 time: 0.031032 Jan 28 02:01:13.286675 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 348/699] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:13 2022] GET /compute/v2.1/servers/367b6b36-483a-4cc8-b26a-2921068ed175 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:01:13.327051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3f16ab7b-3cf9-4b2f-9c90-d56d70f9e75e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:13.327703 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3f16ab7b-3cf9-4b2f-9c90-d56d70f9e75e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:13.333679 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f16ab7b-3cf9-4b2f-9c90-d56d70f9e75e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:13.334123 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f16ab7b-3cf9-4b2f-9c90-d56d70f9e75e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:13.334898 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f16ab7b-3cf9-4b2f-9c90-d56d70f9e75e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:13.335329 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f16ab7b-3cf9-4b2f-9c90-d56d70f9e75e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:13.468133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3f16ab7b-3cf9-4b2f-9c90-d56d70f9e75e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:13.476250 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3f16ab7b-3cf9-4b2f-9c90-d56d70f9e75e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1547 microversion: 2.1 time: 0.152814 Jan 28 02:01:13.476848 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 352/700] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:13 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:13.494438 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d8755202-d6c6-4803-af28-db220dac6b37 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:13.495501 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d8755202-d6c6-4803-af28-db220dac6b37 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:13.501359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8755202-d6c6-4803-af28-db220dac6b37 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:13.501813 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8755202-d6c6-4803-af28-db220dac6b37 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:13.502596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8755202-d6c6-4803-af28-db220dac6b37 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:13.503028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8755202-d6c6-4803-af28-db220dac6b37 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:13.590718 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d8755202-d6c6-4803-af28-db220dac6b37 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099819 Jan 28 02:01:13.591300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 349/701] 10.222.0.96 () {58 vars in 1274 bytes} [Fri Jan 28 02:01:13 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:01:14.889685 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-6bfabcf9-2d6e-48d1-87f5-41cf545b067f req-b0bc462e-b1cb-4b14-be7c-a4fef4a539f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3", "tag": "29b6b39c-b993-4f94-9cd1-2d095d6ea243"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:14.891186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:14.891186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:01:14.895653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-78c44390-f6e7-48fe-9922-e56fe6cb79a9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:14.896581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-78c44390-f6e7-48fe-9922-e56fe6cb79a9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:14.898687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-6bfabcf9-2d6e-48d1-87f5-41cf545b067f req-b0bc462e-b1cb-4b14-be7c-a4fef4a539f2 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:14.899373 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-6bfabcf9-2d6e-48d1-87f5-41cf545b067f req-b0bc462e-b1cb-4b14-be7c-a4fef4a539f2 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:14.902774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78c44390-f6e7-48fe-9922-e56fe6cb79a9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:14.903212 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78c44390-f6e7-48fe-9922-e56fe6cb79a9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:14.904408 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78c44390-f6e7-48fe-9922-e56fe6cb79a9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:14.904849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78c44390-f6e7-48fe-9922-e56fe6cb79a9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:14.911402 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-6bfabcf9-2d6e-48d1-87f5-41cf545b067f req-b0bc462e-b1cb-4b14-be7c-a4fef4a539f2 service nova] Creating event network-changed:29b6b39c-b993-4f94-9cd1-2d095d6ea243 for instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 on hv-cinder-82497 Jan 28 02:01:14.916622 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-6bfabcf9-2d6e-48d1-87f5-41cf545b067f req-b0bc462e-b1cb-4b14-be7c-a4fef4a539f2 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031134 Jan 28 02:01:14.917676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 350/702] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:16.429445 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-78c44390-f6e7-48fe-9922-e56fe6cb79a9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 14 microversion: 2.1 time: 1.546855 Jan 28 02:01:16.430091 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 353/703] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:14 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 14 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:01:17.441484 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f17bdc32-b34c-42d3-8236-af35458ed6fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:17.442545 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f17bdc32-b34c-42d3-8236-af35458ed6fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:17.451178 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f17bdc32-b34c-42d3-8236-af35458ed6fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:17.451832 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f17bdc32-b34c-42d3-8236-af35458ed6fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:17.452659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f17bdc32-b34c-42d3-8236-af35458ed6fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:17.453139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f17bdc32-b34c-42d3-8236-af35458ed6fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:17.553188 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f17bdc32-b34c-42d3-8236-af35458ed6fb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 14 microversion: 2.1 time: 0.115690 Jan 28 02:01:17.553822 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 351/704] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:17 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:01:18.564876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-10f1dd2e-45a2-4500-882b-18fa5685299b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:18.565893 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-10f1dd2e-45a2-4500-882b-18fa5685299b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:18.572764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10f1dd2e-45a2-4500-882b-18fa5685299b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:18.573484 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10f1dd2e-45a2-4500-882b-18fa5685299b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:18.574378 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10f1dd2e-45a2-4500-882b-18fa5685299b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:18.574814 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10f1dd2e-45a2-4500-882b-18fa5685299b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:20.837163 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-10f1dd2e-45a2-4500-882b-18fa5685299b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 14 microversion: 2.1 time: 2.276124 Jan 28 02:01:20.837846 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 354/705] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:18 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 14 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:01:21.848430 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-77bc228c-7c2e-437a-b03f-a70d85c3532f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:21.849401 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-77bc228c-7c2e-437a-b03f-a70d85c3532f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:21.856884 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77bc228c-7c2e-437a-b03f-a70d85c3532f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:21.857335 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77bc228c-7c2e-437a-b03f-a70d85c3532f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:21.858113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77bc228c-7c2e-437a-b03f-a70d85c3532f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:21.858545 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77bc228c-7c2e-437a-b03f-a70d85c3532f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:21.957214 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-77bc228c-7c2e-437a-b03f-a70d85c3532f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 14 microversion: 2.1 time: 0.112732 Jan 28 02:01:21.957854 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 352/706] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:21 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:01:22.123753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2047398272", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "f97ed89c-681e-4768-b1be-7eb9acf480b2"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:22.178872 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] validate_networks() for [('f97ed89c-681e-4768-b1be-7eb9acf480b2', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:01:22.537717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:01:22.538146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:01:22.538618 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:01:22.539030 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:01:22.539443 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:01:22.549287 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:22.549734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:22.550544 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:22.551400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:22.566993 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Getting quotas for project cf861e434da344c89d039fa373bd0742. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:22.570887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Getting quotas for user 4208d3afaa374826b47a3716a2e6d7cc and project cf861e434da344c89d039fa373bd0742. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:22.582678 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:01:22.585194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:01:22.631647 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-315a7ef2-4ece-4d49-ade6-6e7aae3b75c2 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511733 Jan 28 02:01:22.632212 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 355/707] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 02:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:01:22.642846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5b360e5e-fa18-4743-9c64-00e4c245d8d0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:22.643540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5b360e5e-fa18-4743-9c64-00e4c245d8d0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:22.703080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5b360e5e-fa18-4743-9c64-00e4c245d8d0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:22.709922 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5b360e5e-fa18-4743-9c64-00e4c245d8d0 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1219 microversion: 2.1 time: 0.071104 Jan 28 02:01:22.710495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 353/708] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:22 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:22.968189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a69bf4ba-3a25-416f-b626-1ef9ff1d3484 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:22.969194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a69bf4ba-3a25-416f-b626-1ef9ff1d3484 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:22.976249 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a69bf4ba-3a25-416f-b626-1ef9ff1d3484 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:22.976771 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a69bf4ba-3a25-416f-b626-1ef9ff1d3484 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:22.977618 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a69bf4ba-3a25-416f-b626-1ef9ff1d3484 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:22.978133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a69bf4ba-3a25-416f-b626-1ef9ff1d3484 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:23.727313 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-787d2c4e-0946-4c24-95c6-19b537685aa3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:23.727833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-787d2c4e-0946-4c24-95c6-19b537685aa3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:23.735891 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-787d2c4e-0946-4c24-95c6-19b537685aa3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:23.736339 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-787d2c4e-0946-4c24-95c6-19b537685aa3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:23.737143 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-787d2c4e-0946-4c24-95c6-19b537685aa3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:23.737581 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-787d2c4e-0946-4c24-95c6-19b537685aa3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:23.796420 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-787d2c4e-0946-4c24-95c6-19b537685aa3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:23.803687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-787d2c4e-0946-4c24-95c6-19b537685aa3 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1223 microversion: 2.1 time: 0.080155 Jan 28 02:01:23.804249 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 354/709] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:23 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:24.821282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f79c394f-0b3c-405d-8783-643659823797 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:24.821963 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f79c394f-0b3c-405d-8783-643659823797 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:24.828525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f79c394f-0b3c-405d-8783-643659823797 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:24.829011 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f79c394f-0b3c-405d-8783-643659823797 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:24.829786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f79c394f-0b3c-405d-8783-643659823797 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:24.830222 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f79c394f-0b3c-405d-8783-643659823797 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:24.889740 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f79c394f-0b3c-405d-8783-643659823797 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:24.897001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f79c394f-0b3c-405d-8783-643659823797 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1223 microversion: 2.1 time: 0.079329 Jan 28 02:01:24.897579 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 355/710] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:24 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:25.330191 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a69bf4ba-3a25-416f-b626-1ef9ff1d3484 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 14 microversion: 2.1 time: 2.365861 Jan 28 02:01:25.330804 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 356/711] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:22 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 14 bytes in 2368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:01:25.914290 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3a7aaf7c-3b39-41d5-87ec-199be7995435 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:25.914900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3a7aaf7c-3b39-41d5-87ec-199be7995435 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:25.921961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a7aaf7c-3b39-41d5-87ec-199be7995435 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:25.922419 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a7aaf7c-3b39-41d5-87ec-199be7995435 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:25.923199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a7aaf7c-3b39-41d5-87ec-199be7995435 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:25.923639 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a7aaf7c-3b39-41d5-87ec-199be7995435 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:25.992981 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3a7aaf7c-3b39-41d5-87ec-199be7995435 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:26.001117 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3a7aaf7c-3b39-41d5-87ec-199be7995435 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1271 microversion: 2.1 time: 0.090417 Jan 28 02:01:26.001687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 356/712] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:25 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:26.342589 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a0808cbc-98c1-4921-a67e-8388d23c893a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:26.343589 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a0808cbc-98c1-4921-a67e-8388d23c893a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:26.350611 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a0808cbc-98c1-4921-a67e-8388d23c893a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:26.351069 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a0808cbc-98c1-4921-a67e-8388d23c893a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:26.351859 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a0808cbc-98c1-4921-a67e-8388d23c893a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:26.352305 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a0808cbc-98c1-4921-a67e-8388d23c893a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:26.473319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a0808cbc-98c1-4921-a67e-8388d23c893a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 14 microversion: 2.1 time: 0.134969 Jan 28 02:01:26.473864 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 357/713] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:26 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:01:26.983333 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cb9ca328-23f7-41f1-9db0-03aae4837769 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:26.983867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cb9ca328-23f7-41f1-9db0-03aae4837769 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:26.989691 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb9ca328-23f7-41f1-9db0-03aae4837769 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:26.990147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb9ca328-23f7-41f1-9db0-03aae4837769 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:26.990930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb9ca328-23f7-41f1-9db0-03aae4837769 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:26.991365 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb9ca328-23f7-41f1-9db0-03aae4837769 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.018408 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-da2ab034-4deb-4b5a-bb44-8bd113a38401 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:27.019425 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-da2ab034-4deb-4b5a-bb44-8bd113a38401 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:27.023069 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cb9ca328-23f7-41f1-9db0-03aae4837769 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments/0b579a35-bad7-4b0e-aa9c-b47fb5999924" status: 200 len: 194 microversion: 2.20 time: 0.043845 Jan 28 02:01:27.025934 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da2ab034-4deb-4b5a-bb44-8bd113a38401 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.027107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da2ab034-4deb-4b5a-bb44-8bd113a38401 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.027966 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da2ab034-4deb-4b5a-bb44-8bd113a38401 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.028472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da2ab034-4deb-4b5a-bb44-8bd113a38401 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.030930 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 357/714] 10.222.0.96 () {60 vars in 1453 bytes} [Fri Jan 28 02:01:26 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments/0b579a35-bad7-4b0e-aa9c-b47fb5999924 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:27.097163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c12c75c1-693b-483f-b2e7-7d97c616b9a3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:27.097655 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c12c75c1-693b-483f-b2e7-7d97c616b9a3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:27.103431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c12c75c1-693b-483f-b2e7-7d97c616b9a3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.103885 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c12c75c1-693b-483f-b2e7-7d97c616b9a3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.105599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c12c75c1-693b-483f-b2e7-7d97c616b9a3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.106001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c12c75c1-693b-483f-b2e7-7d97c616b9a3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.194084 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-c12c75c1-693b-483f-b2e7-7d97c616b9a3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lazy-loading 'services' on Instance uuid 7a1879ef-ae58-41eb-9c13-3f9a3988a970 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:01:27.259922 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c12c75c1-693b-483f-b2e7-7d97c616b9a3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "DELETE /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments/0b579a35-bad7-4b0e-aa9c-b47fb5999924" status: 202 len: 0 microversion: 2.20 time: 0.166315 Jan 28 02:01:27.261045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 358/715] 10.222.0.96 () {60 vars in 1456 bytes} [Fri Jan 28 02:01:27 2022] DELETE /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments/0b579a35-bad7-4b0e-aa9c-b47fb5999924 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:01:27.269844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-58d51d7c-8e9a-4cdf-bb81-47062313bf1a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:27.271284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-58d51d7c-8e9a-4cdf-bb81-47062313bf1a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:27.279781 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58d51d7c-8e9a-4cdf-bb81-47062313bf1a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.280396 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58d51d7c-8e9a-4cdf-bb81-47062313bf1a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.281198 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58d51d7c-8e9a-4cdf-bb81-47062313bf1a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.281479 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58d51d7c-8e9a-4cdf-bb81-47062313bf1a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.307735 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-da2ab034-4deb-4b5a-bb44-8bd113a38401 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:27.311539 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-58d51d7c-8e9a-4cdf-bb81-47062313bf1a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045756 Jan 28 02:01:27.313625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 359/716] 10.222.0.96 () {60 vars in 1342 bytes} [Fri Jan 28 02:01:27 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:01:27.318185 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-da2ab034-4deb-4b5a-bb44-8bd113a38401 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1319 microversion: 2.1 time: 0.303641 Jan 28 02:01:27.318849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 358/717] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:27 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:27.478273 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-31265914-955f-4d42-b15e-62d7d0d4a212 req-0d0187b2-813f-4aab-9ac5-3f4fc041b23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6", "tag": "1bc7fefe-60b1-4cd1-929b-b25ada74a928"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:27.480248 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:27.480248 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:01:27.485741 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ed9cd3a4-b51c-42db-9f13-bd734ff01c63 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:27.486714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ed9cd3a4-b51c-42db-9f13-bd734ff01c63 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:27.488427 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-31265914-955f-4d42-b15e-62d7d0d4a212 req-0d0187b2-813f-4aab-9ac5-3f4fc041b23d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.489181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-31265914-955f-4d42-b15e-62d7d0d4a212 req-0d0187b2-813f-4aab-9ac5-3f4fc041b23d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.494814 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed9cd3a4-b51c-42db-9f13-bd734ff01c63 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.496645 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed9cd3a4-b51c-42db-9f13-bd734ff01c63 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.498212 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed9cd3a4-b51c-42db-9f13-bd734ff01c63 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:27.498703 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed9cd3a4-b51c-42db-9f13-bd734ff01c63 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:27.502737 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-31265914-955f-4d42-b15e-62d7d0d4a212 req-0d0187b2-813f-4aab-9ac5-3f4fc041b23d service nova] Creating event network-changed:1bc7fefe-60b1-4cd1-929b-b25ada74a928 for instance 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 on hv-cinder-82497 Jan 28 02:01:27.507426 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-31265914-955f-4d42-b15e-62d7d0d4a212 req-0d0187b2-813f-4aab-9ac5-3f4fc041b23d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033454 Jan 28 02:01:27.508031 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 360/718] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:27.615730 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ed9cd3a4-b51c-42db-9f13-bd734ff01c63 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 6451 microversion: 2.1 time: 0.135322 Jan 28 02:01:27.616554 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 359/719] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:27 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 6451 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:28.324505 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8e107a49-5e37-4263-acef-d9df298beb77 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:28.325459 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8e107a49-5e37-4263-acef-d9df298beb77 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:28.331996 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e107a49-5e37-4263-acef-d9df298beb77 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.332452 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e107a49-5e37-4263-acef-d9df298beb77 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.333288 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e107a49-5e37-4263-acef-d9df298beb77 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.333727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e107a49-5e37-4263-acef-d9df298beb77 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.336549 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bfc17e7d-efa2-4c6c-864b-30bffeb288b6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:28.337291 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bfc17e7d-efa2-4c6c-864b-30bffeb288b6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:28.345790 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfc17e7d-efa2-4c6c-864b-30bffeb288b6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.346240 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfc17e7d-efa2-4c6c-864b-30bffeb288b6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.347035 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfc17e7d-efa2-4c6c-864b-30bffeb288b6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.347498 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfc17e7d-efa2-4c6c-864b-30bffeb288b6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.369594 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8e107a49-5e37-4263-acef-d9df298beb77 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049949 Jan 28 02:01:28.370298 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 361/720] 10.222.0.96 () {60 vars in 1342 bytes} [Fri Jan 28 02:01:28 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:28.628406 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-04492ba8-d1dc-42b0-bdac-02793942bbee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:28.629882 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-04492ba8-d1dc-42b0-bdac-02793942bbee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:28.638418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04492ba8-d1dc-42b0-bdac-02793942bbee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.638884 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04492ba8-d1dc-42b0-bdac-02793942bbee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.639737 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04492ba8-d1dc-42b0-bdac-02793942bbee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:28.640430 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-04492ba8-d1dc-42b0-bdac-02793942bbee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:28.688499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bfc17e7d-efa2-4c6c-864b-30bffeb288b6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:28.695956 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bfc17e7d-efa2-4c6c-864b-30bffeb288b6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1319 microversion: 2.1 time: 0.363546 Jan 28 02:01:28.696518 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 360/721] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:28 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:28.779472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-04492ba8-d1dc-42b0-bdac-02793942bbee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 12803 microversion: 2.1 time: 0.154658 Jan 28 02:01:28.780294 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 362/722] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:28 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 12803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:29.381569 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0f46fe3b-1644-4158-961c-2ce71343ec3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:29.382483 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0f46fe3b-1644-4158-961c-2ce71343ec3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:29.389323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f46fe3b-1644-4158-961c-2ce71343ec3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.389785 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f46fe3b-1644-4158-961c-2ce71343ec3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.390561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f46fe3b-1644-4158-961c-2ce71343ec3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.390991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f46fe3b-1644-4158-961c-2ce71343ec3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.423720 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0f46fe3b-1644-4158-961c-2ce71343ec3d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045934 Jan 28 02:01:29.424447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 361/723] 10.222.0.96 () {60 vars in 1342 bytes} [Fri Jan 28 02:01:29 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:29.495095 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9246548c-6829-4c5d-bbec-67104c494155 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:29.496044 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9246548c-6829-4c5d-bbec-67104c494155 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:29.504681 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9246548c-6829-4c5d-bbec-67104c494155 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.505652 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9246548c-6829-4c5d-bbec-67104c494155 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.506041 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9246548c-6829-4c5d-bbec-67104c494155 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.506487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9246548c-6829-4c5d-bbec-67104c494155 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.535531 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9246548c-6829-4c5d-bbec-67104c494155 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:01:29.616986 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9246548c-6829-4c5d-bbec-67104c494155 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "DELETE /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 204 len: 0 microversion: 2.20 time: 0.127284 Jan 28 02:01:29.617627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 363/724] 10.222.0.96 () {60 vars in 1279 bytes} [Fri Jan 28 02:01:29 2022] DELETE /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 02:01:29.627744 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:29.628637 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:29.634671 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.635116 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.636169 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.636674 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.713900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8617a5ce-10d4-4108-a882-4835786855ee tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:29.714605 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8617a5ce-10d4-4108-a882-4835786855ee tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:29.720500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8617a5ce-10d4-4108-a882-4835786855ee tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.720998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8617a5ce-10d4-4108-a882-4835786855ee tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.722069 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8617a5ce-10d4-4108-a882-4835786855ee tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.722454 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8617a5ce-10d4-4108-a882-4835786855ee tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.779487 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:29.787530 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:29.789406 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:29.790587 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bb711d62-6e1a-44b8-894b-61d2c4fc2f18 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.166734 Jan 28 02:01:29.791140 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 362/725] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:29 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:29.796580 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-407294ee-c540-47e5-9fd4-6a98d5d98454 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:29.797628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-407294ee-c540-47e5-9fd4-6a98d5d98454 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:29.803785 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-407294ee-c540-47e5-9fd4-6a98d5d98454 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.804325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-407294ee-c540-47e5-9fd4-6a98d5d98454 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.805333 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-407294ee-c540-47e5-9fd4-6a98d5d98454 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:29.805776 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-407294ee-c540-47e5-9fd4-6a98d5d98454 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:29.869270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8617a5ce-10d4-4108-a882-4835786855ee tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:29.877555 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8617a5ce-10d4-4108-a882-4835786855ee tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1319 microversion: 2.1 time: 0.167763 Jan 28 02:01:29.878138 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 364/726] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:29 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:29.909612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-407294ee-c540-47e5-9fd4-6a98d5d98454 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 18208 microversion: 2.1 time: 0.116078 Jan 28 02:01:29.910176 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 363/727] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:29 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 18208 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:30.810529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:30.811133 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:30.817310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:30.817758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:30.818525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:30.818959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:30.894127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-08f5d272-4458-44a6-be92-cb50b33f3e8b tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:30.895571 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-08f5d272-4458-44a6-be92-cb50b33f3e8b tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:30.902101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08f5d272-4458-44a6-be92-cb50b33f3e8b tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:30.902833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08f5d272-4458-44a6-be92-cb50b33f3e8b tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:30.903836 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08f5d272-4458-44a6-be92-cb50b33f3e8b tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:30.904718 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08f5d272-4458-44a6-be92-cb50b33f3e8b tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:30.962467 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:30.970675 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:30.972265 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:30.973431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-08f93c1f-982b-4959-80e6-2457a894ca46 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.167278 Jan 28 02:01:30.974087 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 365/728] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:30 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:30.982214 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-82958929-aaf2-4452-9de9-04e032b1f867 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:30.983741 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-82958929-aaf2-4452-9de9-04e032b1f867 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:30.990534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82958929-aaf2-4452-9de9-04e032b1f867 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:30.993107 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82958929-aaf2-4452-9de9-04e032b1f867 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:30.994122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82958929-aaf2-4452-9de9-04e032b1f867 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:30.998837 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82958929-aaf2-4452-9de9-04e032b1f867 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:31.048301 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-08f5d272-4458-44a6-be92-cb50b33f3e8b tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:31.055665 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-08f5d272-4458-44a6-be92-cb50b33f3e8b tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1319 microversion: 2.1 time: 0.165488 Jan 28 02:01:31.056414 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 364/729] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:30 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:31.098252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-82958929-aaf2-4452-9de9-04e032b1f867 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 18356 microversion: 2.1 time: 0.122576 Jan 28 02:01:31.098905 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 366/730] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:30 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 18356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:31.992763 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:31.993386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:32.001073 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.001528 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.002302 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.002734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.075509 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2591876f-7226-4700-98d1-7f6673939d8a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:32.076521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2591876f-7226-4700-98d1-7f6673939d8a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:32.083322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2591876f-7226-4700-98d1-7f6673939d8a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.083936 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2591876f-7226-4700-98d1-7f6673939d8a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.085030 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2591876f-7226-4700-98d1-7f6673939d8a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.085574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2591876f-7226-4700-98d1-7f6673939d8a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.401782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:32.416146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:32.418819 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:32.420845 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7dbd4323-e21c-4232-ad85-0ef3525485ee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1723 microversion: 2.20 time: 0.432087 Jan 28 02:01:32.421918 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 365/731] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:31 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:32.428467 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-061364b8-0dbf-456d-b2e4-320deb585847 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:32.429209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2591876f-7226-4700-98d1-7f6673939d8a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:32.430101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-061364b8-0dbf-456d-b2e4-320deb585847 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:32.436895 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2591876f-7226-4700-98d1-7f6673939d8a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1319 microversion: 2.1 time: 0.365489 Jan 28 02:01:32.437539 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 367/732] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:32 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:32.443235 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-061364b8-0dbf-456d-b2e4-320deb585847 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.443962 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-061364b8-0dbf-456d-b2e4-320deb585847 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.445140 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-061364b8-0dbf-456d-b2e4-320deb585847 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.446094 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-061364b8-0dbf-456d-b2e4-320deb585847 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.566666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-061364b8-0dbf-456d-b2e4-320deb585847 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 21935 microversion: 2.1 time: 0.142594 Jan 28 02:01:32.567485 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 366/733] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:32 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 21935 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:32.617846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-d9961daa-54f5-4696-90a0-dde97af8fea2 req-2ec721ac-dd4a-4854-ad0f-2bb7eac21b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6", "name": "network-vif-plugged", "status": "completed", "tag": "1bc7fefe-60b1-4cd1-929b-b25ada74a928"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:32.621445 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:32.621445 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:01:32.629973 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d9961daa-54f5-4696-90a0-dde97af8fea2 req-2ec721ac-dd4a-4854-ad0f-2bb7eac21b95 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.630421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d9961daa-54f5-4696-90a0-dde97af8fea2 req-2ec721ac-dd4a-4854-ad0f-2bb7eac21b95 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.645520 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-d9961daa-54f5-4696-90a0-dde97af8fea2 req-2ec721ac-dd4a-4854-ad0f-2bb7eac21b95 service nova] Creating event network-vif-plugged:1bc7fefe-60b1-4cd1-929b-b25ada74a928 for instance 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 on hv-cinder-82497 Jan 28 02:01:32.652174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-d9961daa-54f5-4696-90a0-dde97af8fea2 req-2ec721ac-dd4a-4854-ad0f-2bb7eac21b95 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038744 Jan 28 02:01:32.653486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 368/734] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:32.915184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-123f12be-df9d-48ad-8ef7-85959feefd82 req-eb68d9c8-5a1c-4bde-ba63-e3904132d1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1879ef-ae58-41eb-9c13-3f9a3988a970", "name": "network-vif-deleted", "tag": "d9332855-e3dc-42d6-9f2e-2138fd34387d"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:32.917398 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:32.917398 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:01:32.927950 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-123f12be-df9d-48ad-8ef7-85959feefd82 req-eb68d9c8-5a1c-4bde-ba63-e3904132d1b3 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:32.928388 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-123f12be-df9d-48ad-8ef7-85959feefd82 req-eb68d9c8-5a1c-4bde-ba63-e3904132d1b3 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:32.950790 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-123f12be-df9d-48ad-8ef7-85959feefd82 req-eb68d9c8-5a1c-4bde-ba63-e3904132d1b3 service nova] Creating event network-vif-deleted:d9332855-e3dc-42d6-9f2e-2138fd34387d for instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 on hv-cinder-82497 Jan 28 02:01:32.960902 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-123f12be-df9d-48ad-8ef7-85959feefd82 req-eb68d9c8-5a1c-4bde-ba63-e3904132d1b3 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049118 Jan 28 02:01:32.961578 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 367/735] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:01:33.440550 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:33.441486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:33.448328 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.449361 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.455254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1c4614a5-6304-4dd3-aeb1-e851021acbf1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:33.455954 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1c4614a5-6304-4dd3-aeb1-e851021acbf1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:33.458325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.458790 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.468308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c4614a5-6304-4dd3-aeb1-e851021acbf1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.468761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c4614a5-6304-4dd3-aeb1-e851021acbf1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.469783 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c4614a5-6304-4dd3-aeb1-e851021acbf1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.470446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c4614a5-6304-4dd3-aeb1-e851021acbf1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.495858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.496553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.497182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lazy-loading 'fault' on Instance uuid 7a1879ef-ae58-41eb-9c13-3f9a3988a970 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:01:33.565022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:33.574824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:33.577530 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:33.579456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-473c2b32-7adb-490d-8de5-28ebd721c061 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 200 len: 1370 microversion: 2.20 time: 0.143614 Jan 28 02:01:33.591673 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 369/736] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:33 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:33.596860 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-07d7755a-33fb-45ad-8d64-f75c87360b8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:33.597847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-07d7755a-33fb-45ad-8d64-f75c87360b8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:33.604358 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-07d7755a-33fb-45ad-8d64-f75c87360b8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.605266 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-07d7755a-33fb-45ad-8d64-f75c87360b8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.606083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-07d7755a-33fb-45ad-8d64-f75c87360b8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:33.606613 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-07d7755a-33fb-45ad-8d64-f75c87360b8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:33.745941 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-07d7755a-33fb-45ad-8d64-f75c87360b8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 23128 microversion: 2.1 time: 0.151553 Jan 28 02:01:33.746816 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 370/737] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:33 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 23128 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:33.758910 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1c4614a5-6304-4dd3-aeb1-e851021acbf1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:33.768371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1c4614a5-6304-4dd3-aeb1-e851021acbf1 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1319 microversion: 2.1 time: 0.316923 Jan 28 02:01:33.769165 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 368/738] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:33 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:34.599245 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:34.600503 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:34.608381 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.608865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.609655 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.610092 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.624766 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] HTTP exception thrown: Instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 could not be found. Jan 28 02:01:34.625391 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Returning 404 to user: Instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:01:34.626266 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8ef39cf2-47a2-478b-b420-9a7ab025f450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 404 len: 111 microversion: 2.20 time: 0.031224 Jan 28 02:01:34.626833 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 371/739] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:34 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:01:34.635061 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d591283b-efbc-4ce1-abe7-020ddeeeb06b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '.version_select at 0x7f523fee90d0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:34.656049 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d591283b-efbc-4ce1-abe7-020ddeeeb06b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-825696241" status: 204 len: 0 microversion: 2.20 time: 0.024560 Jan 28 02:01:34.656650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 369/740] 10.222.0.96 () {60 vars in 1258 bytes} [Fri Jan 28 02:01:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-825696241 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 02:01:34.757960 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c2e9d5fd-dd00-49cd-a43a-5d7b9d915bf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:34.759087 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c2e9d5fd-dd00-49cd-a43a-5d7b9d915bf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:34.765310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2e9d5fd-dd00-49cd-a43a-5d7b9d915bf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.765853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2e9d5fd-dd00-49cd-a43a-5d7b9d915bf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.766712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2e9d5fd-dd00-49cd-a43a-5d7b9d915bf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.767227 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2e9d5fd-dd00-49cd-a43a-5d7b9d915bf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.786458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-af9e2051-f89f-4777-86f1-a71148a11beb tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:34.787177 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-af9e2051-f89f-4777-86f1-a71148a11beb tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:34.794887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af9e2051-f89f-4777-86f1-a71148a11beb tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.795493 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af9e2051-f89f-4777-86f1-a71148a11beb tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.796465 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af9e2051-f89f-4777-86f1-a71148a11beb tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.797062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af9e2051-f89f-4777-86f1-a71148a11beb tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.883240 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c2e9d5fd-dd00-49cd-a43a-5d7b9d915bf2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 23799 microversion: 2.1 time: 0.129025 Jan 28 02:01:34.884179 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 372/741] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:34 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 23799 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:34.959768 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-af9e2051-f89f-4777-86f1-a71148a11beb tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:34.967987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-af9e2051-f89f-4777-86f1-a71148a11beb tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1508 microversion: 2.1 time: 0.185142 Jan 28 02:01:34.968892 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 370/742] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:34 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:34.987000 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c51b0794-64fd-4805-826d-1d21ba0e0808 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "760fbdaf-cf9c-4892-860d-74bbbdcea13e", "device": "/dev/sdb"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:34.988688 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c51b0794-64fd-4805-826d-1d21ba0e0808 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:34.997578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c51b0794-64fd-4805-826d-1d21ba0e0808 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.998043 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c51b0794-64fd-4805-826d-1d21ba0e0808 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:34.999199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c51b0794-64fd-4805-826d-1d21ba0e0808 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:34.999797 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c51b0794-64fd-4805-826d-1d21ba0e0808 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:35.325762 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c51b0794-64fd-4805-826d-1d21ba0e0808 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "POST /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342771 Jan 28 02:01:35.327098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 373/743] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 02:01:34 2022] POST /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:35.470435 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2e3628b4-7d25-4269-a35c-7f2efe22b5d0 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'create', calling method: .version_select at 0x7f523fee90d0>, body: {"keypair": {"name": "tempest-keypair-1009115177"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:35.487532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-2e3628b4-7d25-4269-a35c-7f2efe22b5d0 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for project c744efbffa214f18ab24d619620343c6. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:35.491472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-2e3628b4-7d25-4269-a35c-7f2efe22b5d0 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for user c34c05b7e55447f2a5ddf9c9b9299f44 and project c744efbffa214f18ab24d619620343c6. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:35.623245 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-2e3628b4-7d25-4269-a35c-7f2efe22b5d0 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for project c744efbffa214f18ab24d619620343c6. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:35.627226 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-2e3628b4-7d25-4269-a35c-7f2efe22b5d0 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for user c34c05b7e55447f2a5ddf9c9b9299f44 and project c744efbffa214f18ab24d619620343c6. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:35.640694 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2e3628b4-7d25-4269-a35c-7f2efe22b5d0 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.174481 Jan 28 02:01:35.641528 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 371/744] 10.222.0.96 () {62 vars in 1198 bytes} [Fri Jan 28 02:01:35 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:01:35.896058 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-93515856-6062-4042-b272-74217a29a2be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:35.897179 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-93515856-6062-4042-b272-74217a29a2be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:35.907687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93515856-6062-4042-b272-74217a29a2be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:35.908180 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93515856-6062-4042-b272-74217a29a2be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:35.909139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93515856-6062-4042-b272-74217a29a2be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:35.909600 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93515856-6062-4042-b272-74217a29a2be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:36.029500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-93515856-6062-4042-b272-74217a29a2be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 24940 microversion: 2.1 time: 0.137045 Jan 28 02:01:36.030464 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 374/745] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:35 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 24940 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:37.010922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-731980640", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "828bafe9-6988-48d7-866b-8d25ce9d4df3"}], "security_groups": [{"name": "tempest-securitygroup--1573336488"}], "key_name": "tempest-keypair-1009115177", "user_data": "}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:37.042215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d17adcf3-ada7-4890-83c1-6f64ab7a8aa4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:37.043264 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d17adcf3-ada7-4890-83c1-6f64ab7a8aa4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:37.049723 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d17adcf3-ada7-4890-83c1-6f64ab7a8aa4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:37.050175 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d17adcf3-ada7-4890-83c1-6f64ab7a8aa4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:37.050960 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d17adcf3-ada7-4890-83c1-6f64ab7a8aa4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:37.051397 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d17adcf3-ada7-4890-83c1-6f64ab7a8aa4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:37.107964 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] validate_networks() for [('828bafe9-6988-48d7-866b-8d25ce9d4df3', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:01:37.150000 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d17adcf3-ada7-4890-83c1-6f64ab7a8aa4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 26086 microversion: 2.1 time: 0.112090 Jan 28 02:01:37.151496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 375/746] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:37 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 26086 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:01:37.489499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:01:37.489926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:01:37.490393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:01:37.490798 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:01:37.491207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:01:37.499891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:37.500330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:37.501160 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:37.501590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:37.517321 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for project c744efbffa214f18ab24d619620343c6. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:01:37.521202 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Getting quotas for user c34c05b7e55447f2a5ddf9c9b9299f44 and project c744efbffa214f18ab24d619620343c6. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:01:37.533598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:01:37.535948 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:01:37.581728 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3086f1e6-2c8b-4cab-aa26-8409acb46f3e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.575580 Jan 28 02:01:37.582360 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 372/747] 10.222.0.96 () {62 vars in 1187 bytes} [Fri Jan 28 02:01:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 02:01:37.594086 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-91129e67-314f-4693-885c-b7b85ac9e3e6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:37.594775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-91129e67-314f-4693-885c-b7b85ac9e3e6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:37.647131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-91129e67-314f-4693-885c-b7b85ac9e3e6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:37.656576 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-91129e67-314f-4693-885c-b7b85ac9e3e6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:37.658258 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-91129e67-314f-4693-885c-b7b85ac9e3e6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:37.659270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-91129e67-314f-4693-885c-b7b85ac9e3e6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1281 microversion: 2.20 time: 0.069758 Jan 28 02:01:37.659905 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 376/748] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:37 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:38.162604 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4ecfd896-30a3-4def-beec-313134f165c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:38.163781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4ecfd896-30a3-4def-beec-313134f165c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:38.171308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ecfd896-30a3-4def-beec-313134f165c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.171923 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ecfd896-30a3-4def-beec-313134f165c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.172839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ecfd896-30a3-4def-beec-313134f165c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.173364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ecfd896-30a3-4def-beec-313134f165c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.308672 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4ecfd896-30a3-4def-beec-313134f165c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 27195 microversion: 2.1 time: 0.148923 Jan 28 02:01:38.309619 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 373/749] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:38 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 27195 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:38.678865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:38.679473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:38.687798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.688243 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.689047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:38.689482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:38.793540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.802712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.804347 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:38.805632 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f3ee649e-bd83-4748-a243-e03fe002131f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1341 microversion: 2.20 time: 0.130466 Jan 28 02:01:38.806424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 377/750] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:38 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1341 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:39.320561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-330e5cd4-d0c6-4ab7-95e7-f59f6b408c50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:39.321743 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-330e5cd4-d0c6-4ab7-95e7-f59f6b408c50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:39.328615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-330e5cd4-d0c6-4ab7-95e7-f59f6b408c50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.329182 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-330e5cd4-d0c6-4ab7-95e7-f59f6b408c50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.330165 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-330e5cd4-d0c6-4ab7-95e7-f59f6b408c50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.330683 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-330e5cd4-d0c6-4ab7-95e7-f59f6b408c50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.428306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-330e5cd4-d0c6-4ab7-95e7-f59f6b408c50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 27839 microversion: 2.1 time: 0.111629 Jan 28 02:01:39.429660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 374/751] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:39 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 27839 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:39.825716 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:39.826353 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:39.833255 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.833937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:39.834998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:39.835446 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.294307 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.302625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.304367 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:40.305727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8eb55252-a228-4bda-afa9-7a9466ae9ce5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.484526 Jan 28 02:01:40.306463 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 378/752] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:39 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:40.442779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-72f48ca9-693c-4a8d-9fa3-f431403bbe3e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:40.443949 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-72f48ca9-693c-4a8d-9fa3-f431403bbe3e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:40.451378 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72f48ca9-693c-4a8d-9fa3-f431403bbe3e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.451841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72f48ca9-693c-4a8d-9fa3-f431403bbe3e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.452628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72f48ca9-693c-4a8d-9fa3-f431403bbe3e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.453100 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72f48ca9-693c-4a8d-9fa3-f431403bbe3e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.507798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-d8a77e70-52d0-49b8-89f0-3a96144b1b28 req-29f34a35-ca89-4358-9ba0-a3e2f774313d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e2f5bb-ea79-4637-b7a5-5f4d10aebe58", "tag": "b3df727d-fb39-47e3-88bf-cdef71b67bf5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:40.509449 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:40.509449 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:01:40.517323 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d8a77e70-52d0-49b8-89f0-3a96144b1b28 req-29f34a35-ca89-4358-9ba0-a3e2f774313d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:40.517763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d8a77e70-52d0-49b8-89f0-3a96144b1b28 req-29f34a35-ca89-4358-9ba0-a3e2f774313d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:40.532774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-d8a77e70-52d0-49b8-89f0-3a96144b1b28 req-29f34a35-ca89-4358-9ba0-a3e2f774313d service nova] Creating event network-changed:b3df727d-fb39-47e3-88bf-cdef71b67bf5 for instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 on hv-cinder-82497 Jan 28 02:01:40.539781 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-d8a77e70-52d0-49b8-89f0-3a96144b1b28 req-29f34a35-ca89-4358-9ba0-a3e2f774313d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035557 Jan 28 02:01:40.540394 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 379/753] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:40.565327 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-72f48ca9-693c-4a8d-9fa3-f431403bbe3e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28209 microversion: 2.1 time: 0.127302 Jan 28 02:01:40.565988 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 375/754] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:40 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:41.325663 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:41.326235 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:41.333813 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.334267 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.335068 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.335509 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.484985 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:41.493735 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:41.495347 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:41.496482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-14e47e8d-0b6f-43e2-93a0-22e3ff4682f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.175155 Jan 28 02:01:41.497074 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 380/755] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:41 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:41.578187 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1e25a084-b1fa-4576-8101-066e6432958e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:41.579103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1e25a084-b1fa-4576-8101-066e6432958e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:41.585744 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e25a084-b1fa-4576-8101-066e6432958e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.586150 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e25a084-b1fa-4576-8101-066e6432958e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.586934 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e25a084-b1fa-4576-8101-066e6432958e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:41.587364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e25a084-b1fa-4576-8101-066e6432958e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:41.697175 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1e25a084-b1fa-4576-8101-066e6432958e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28209 microversion: 2.1 time: 0.122809 Jan 28 02:01:41.698468 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 376/756] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:41 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:42.514579 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:42.515310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:42.527928 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.528829 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.531037 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.531875 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.676366 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:42.685612 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:42.687097 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:42.688448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-50020ce3-1dc5-4bec-be21-a94ace4e0a1c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.177611 Jan 28 02:01:42.689037 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 381/757] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:42 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:42.711413 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f6ddf5cb-711d-48f6-b89b-204f5f83d787 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:42.712502 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f6ddf5cb-711d-48f6-b89b-204f5f83d787 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:42.719438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6ddf5cb-711d-48f6-b89b-204f5f83d787 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.719887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6ddf5cb-711d-48f6-b89b-204f5f83d787 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.720652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6ddf5cb-711d-48f6-b89b-204f5f83d787 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:42.721109 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6ddf5cb-711d-48f6-b89b-204f5f83d787 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:42.824924 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f6ddf5cb-711d-48f6-b89b-204f5f83d787 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28500 microversion: 2.1 time: 0.117350 Jan 28 02:01:42.828782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 377/758] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:42 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28500 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:01:43.705877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:43.706490 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:43.712825 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.713275 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.714050 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.714584 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.837961 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0ba821b1-3459-4258-8409-bd2357b187da tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:43.839369 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0ba821b1-3459-4258-8409-bd2357b187da tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:43.849979 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ba821b1-3459-4258-8409-bd2357b187da tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.850775 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ba821b1-3459-4258-8409-bd2357b187da tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.852472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ba821b1-3459-4258-8409-bd2357b187da tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:43.853583 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ba821b1-3459-4258-8409-bd2357b187da tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:43.863103 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.872787 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.874442 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:43.875596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-163f8781-f9f1-4aba-a859-88ccc640cf29 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.173373 Jan 28 02:01:43.876127 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 382/759] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:43 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:44.897246 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:44.899134 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:44.907332 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.907974 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:44.908933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:44.909519 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:45.056224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:45.064871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:45.069015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:45.069015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-98102fa1-7686-4f9d-a9ae-eedefa4d9b7c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.174353 Jan 28 02:01:45.069015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 383/760] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:44 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:46.017447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0ba821b1-3459-4258-8409-bd2357b187da tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28500 microversion: 2.1 time: 2.184596 Jan 28 02:01:46.021489 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 378/761] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:43 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28500 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:01:46.085514 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:46.086716 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:46.093929 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:46.094643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:46.095587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:46.095997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:46.313706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:46.321879 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:46.324866 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:46.326280 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4bf6ccba-80f8-42a7-8640-5c91ba308820 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.244607 Jan 28 02:01:46.326858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 384/762] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:46 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:47.029079 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-967f25a1-f50f-4597-a1b0-5599b77c35d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:47.030390 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-967f25a1-f50f-4597-a1b0-5599b77c35d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:47.036900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-967f25a1-f50f-4597-a1b0-5599b77c35d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.037347 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-967f25a1-f50f-4597-a1b0-5599b77c35d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.038113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-967f25a1-f50f-4597-a1b0-5599b77c35d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.038552 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-967f25a1-f50f-4597-a1b0-5599b77c35d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.145834 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-967f25a1-f50f-4597-a1b0-5599b77c35d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28668 microversion: 2.1 time: 0.120842 Jan 28 02:01:47.149745 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 379/763] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:47 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28668 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:47.344322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:47.344943 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:47.350819 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.351257 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.352021 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:47.352444 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:47.477497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.485306 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.486791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:47.487888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-24584ae4-6e31-4bdd-8183-1878914b7ee1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.147260 Jan 28 02:01:47.488435 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 385/764] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:47 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:48.158348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f10ad96f-e71a-4f0d-98c3-96948251da80 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:48.159347 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f10ad96f-e71a-4f0d-98c3-96948251da80 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:48.165815 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f10ad96f-e71a-4f0d-98c3-96948251da80 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.166276 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f10ad96f-e71a-4f0d-98c3-96948251da80 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.167587 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f10ad96f-e71a-4f0d-98c3-96948251da80 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.168051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f10ad96f-e71a-4f0d-98c3-96948251da80 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.505072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:48.505685 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:48.511795 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.512250 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.513083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:48.513637 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:48.649701 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:48.659397 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:48.660921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:48.662035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0c5ad3ab-f84c-4927-b887-65aa335c07c8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.160630 Jan 28 02:01:48.662601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 386/765] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:48 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:49.446308 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-f4a1b9b2-5c7c-486a-b2da-9c4100ed485a req-6b0393b7-c997-45c6-98fe-d3d47f39a733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e2f5bb-ea79-4637-b7a5-5f4d10aebe58", "name": "network-vif-plugged", "status": "completed", "tag": "b3df727d-fb39-47e3-88bf-cdef71b67bf5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:49.450078 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:49.450078 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:01:49.462056 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-f4a1b9b2-5c7c-486a-b2da-9c4100ed485a req-6b0393b7-c997-45c6-98fe-d3d47f39a733 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.463188 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-f4a1b9b2-5c7c-486a-b2da-9c4100ed485a req-6b0393b7-c997-45c6-98fe-d3d47f39a733 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.489836 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-f4a1b9b2-5c7c-486a-b2da-9c4100ed485a req-6b0393b7-c997-45c6-98fe-d3d47f39a733 service nova] Creating event network-vif-plugged:b3df727d-fb39-47e3-88bf-cdef71b67bf5 for instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 on hv-cinder-82497 Jan 28 02:01:49.500478 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-f4a1b9b2-5c7c-486a-b2da-9c4100ed485a req-6b0393b7-c997-45c6-98fe-d3d47f39a733 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057966 Jan 28 02:01:49.501565 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 387/766] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:01:49.682857 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:49.684194 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:49.689705 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.690149 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.690921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:49.691352 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:49.817778 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.826180 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.827676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:49.828888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-466ddf87-43e5-42d2-bbf2-1ae4ccdcff4a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.151096 Jan 28 02:01:49.829574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 388/767] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:49 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:50.299451 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f10ad96f-e71a-4f0d-98c3-96948251da80 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28668 microversion: 2.1 time: 2.145188 Jan 28 02:01:50.300814 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 380/768] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:48 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28668 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:50.847071 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:50.847725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:50.853615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.854284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:50.855182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:50.855627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:51.133592 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:51.142288 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:51.143772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:51.144883 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-72e89286-cb9c-4e69-8b1c-f7a85b7667d7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1407 microversion: 2.20 time: 0.301565 Jan 28 02:01:51.145436 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 389/769] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:50 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:01:51.313242 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5b57bae4-6aa2-4701-9541-0bf6d5b4ade5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:51.314136 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5b57bae4-6aa2-4701-9541-0bf6d5b4ade5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:51.320316 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b57bae4-6aa2-4701-9541-0bf6d5b4ade5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:51.320769 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b57bae4-6aa2-4701-9541-0bf6d5b4ade5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:51.321599 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b57bae4-6aa2-4701-9541-0bf6d5b4ade5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:51.322022 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b57bae4-6aa2-4701-9541-0bf6d5b4ade5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:51.422113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5b57bae4-6aa2-4701-9541-0bf6d5b4ade5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28668 microversion: 2.1 time: 0.113413 Jan 28 02:01:51.422832 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 381/770] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:51 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28668 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:51.906646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c37618d6-c591-4142-bb8c-d44aad6d0c2e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:51.907566 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c37618d6-c591-4142-bb8c-d44aad6d0c2e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:51.914756 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c37618d6-c591-4142-bb8c-d44aad6d0c2e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:51.915209 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c37618d6-c591-4142-bb8c-d44aad6d0c2e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:51.916004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c37618d6-c591-4142-bb8c-d44aad6d0c2e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:51.917422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c37618d6-c591-4142-bb8c-d44aad6d0c2e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:51.943721 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c37618d6-c591-4142-bb8c-d44aad6d0c2e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:01:52.030841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c37618d6-c591-4142-bb8c-d44aad6d0c2e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "DELETE /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 204 len: 0 microversion: 2.1 time: 0.127993 Jan 28 02:01:52.033480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 390/771] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:01:51 2022] DELETE /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:01:52.041964 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3dd54981-de23-43d9-8370-2d962c3e2be8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:52.042666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3dd54981-de23-43d9-8370-2d962c3e2be8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:52.049682 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3dd54981-de23-43d9-8370-2d962c3e2be8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.050258 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3dd54981-de23-43d9-8370-2d962c3e2be8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.050894 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3dd54981-de23-43d9-8370-2d962c3e2be8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.051338 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3dd54981-de23-43d9-8370-2d962c3e2be8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.163262 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:52.163976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:52.171729 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.172206 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.173028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.173470 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.267133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3dd54981-de23-43d9-8370-2d962c3e2be8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.274625 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3dd54981-de23-43d9-8370-2d962c3e2be8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1578 microversion: 2.1 time: 0.237069 Jan 28 02:01:52.275230 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 382/772] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:52 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1578 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:52.323323 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.331286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.332879 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:52.334043 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-abcef1c7-d024-43b6-9f56-132bc478558e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1599 microversion: 2.20 time: 0.174893 Jan 28 02:01:52.334609 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 391/773] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:01:52 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:01:52.351150 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7c22f382-eb3c-484e-8831-70b0160158df tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:52.351694 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7c22f382-eb3c-484e-8831-70b0160158df tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:52.357748 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c22f382-eb3c-484e-8831-70b0160158df tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.358192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c22f382-eb3c-484e-8831-70b0160158df tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.358957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c22f382-eb3c-484e-8831-70b0160158df tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.359383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c22f382-eb3c-484e-8831-70b0160158df tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.434869 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fd65c812-8072-41b9-aea4-5c4879d56c7e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:52.435958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fd65c812-8072-41b9-aea4-5c4879d56c7e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:52.438469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7c22f382-eb3c-484e-8831-70b0160158df tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090963 Jan 28 02:01:52.439062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 383/774] 10.222.0.96 () {60 vars in 1315 bytes} [Fri Jan 28 02:01:52 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:01:52.442184 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd65c812-8072-41b9-aea4-5c4879d56c7e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.442716 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd65c812-8072-41b9-aea4-5c4879d56c7e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.443590 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd65c812-8072-41b9-aea4-5c4879d56c7e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:52.444102 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd65c812-8072-41b9-aea4-5c4879d56c7e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:52.558953 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fd65c812-8072-41b9-aea4-5c4879d56c7e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28668 microversion: 2.1 time: 0.128011 Jan 28 02:01:52.562917 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 392/775] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:52 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28668 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:01:53.294958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5bd70e9f-2976-4943-8458-6c4fef1bde23 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:53.295797 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5bd70e9f-2976-4943-8458-6c4fef1bde23 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:53.302182 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5bd70e9f-2976-4943-8458-6c4fef1bde23 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.302717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5bd70e9f-2976-4943-8458-6c4fef1bde23 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.303558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5bd70e9f-2976-4943-8458-6c4fef1bde23 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.304081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5bd70e9f-2976-4943-8458-6c4fef1bde23 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.548643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2cbea485-aad9-4d33-983d-e60cba75843a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:53.555211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2cbea485-aad9-4d33-983d-e60cba75843a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:53.568704 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5bd70e9f-2976-4943-8458-6c4fef1bde23 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:53.571322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2cbea485-aad9-4d33-983d-e60cba75843a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.571900 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2cbea485-aad9-4d33-983d-e60cba75843a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.573293 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2cbea485-aad9-4d33-983d-e60cba75843a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.573933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2cbea485-aad9-4d33-983d-e60cba75843a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.579262 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5bd70e9f-2976-4943-8458-6c4fef1bde23 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1578 microversion: 2.1 time: 0.289813 Jan 28 02:01:53.580420 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 384/776] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:53 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1578 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:53.586562 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-d51a80af-0ab9-4121-87a1-b45349eec115 req-af753ff1-6345-489b-93da-f5b72818e699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e2f5bb-ea79-4637-b7a5-5f4d10aebe58", "tag": "b3df727d-fb39-47e3-88bf-cdef71b67bf5"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:53.591882 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:53.591882 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:01:53.607115 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-d51a80af-0ab9-4121-87a1-b45349eec115 req-af753ff1-6345-489b-93da-f5b72818e699 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.613819 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-d51a80af-0ab9-4121-87a1-b45349eec115 req-af753ff1-6345-489b-93da-f5b72818e699 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.632101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-d51a80af-0ab9-4121-87a1-b45349eec115 req-af753ff1-6345-489b-93da-f5b72818e699 service nova] Creating event network-changed:b3df727d-fb39-47e3-88bf-cdef71b67bf5 for instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 on hv-cinder-82497 Jan 28 02:01:53.643317 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-d51a80af-0ab9-4121-87a1-b45349eec115 req-af753ff1-6345-489b-93da-f5b72818e699 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061313 Jan 28 02:01:53.644188 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 385/777] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:53.652283 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-abca55d0-58cf-42f8-9130-14ad62db1449 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:53.654096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-abca55d0-58cf-42f8-9130-14ad62db1449 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:53.661392 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abca55d0-58cf-42f8-9130-14ad62db1449 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.662191 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abca55d0-58cf-42f8-9130-14ad62db1449 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.663196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abca55d0-58cf-42f8-9130-14ad62db1449 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:53.663858 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abca55d0-58cf-42f8-9130-14ad62db1449 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:53.788435 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2cbea485-aad9-4d33-983d-e60cba75843a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 0.247652 Jan 28 02:01:53.789253 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 393/778] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:01:53 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:53.899750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-abca55d0-58cf-42f8-9130-14ad62db1449 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28668 microversion: 2.1 time: 0.253530 Jan 28 02:01:53.901166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 386/779] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:53 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28668 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:54.598433 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-01f47fd7-152a-4a97-be2d-3af10f8552b4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:54.599258 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-01f47fd7-152a-4a97-be2d-3af10f8552b4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:54.606824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-01f47fd7-152a-4a97-be2d-3af10f8552b4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.607269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-01f47fd7-152a-4a97-be2d-3af10f8552b4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.608047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-01f47fd7-152a-4a97-be2d-3af10f8552b4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.608482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-01f47fd7-152a-4a97-be2d-3af10f8552b4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.728756 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f28177fa-ab90-403f-b022-550e41053039 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:54.730223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f28177fa-ab90-403f-b022-550e41053039 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:54.740468 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f28177fa-ab90-403f-b022-550e41053039 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.741755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f28177fa-ab90-403f-b022-550e41053039 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.742971 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f28177fa-ab90-403f-b022-550e41053039 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.743469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f28177fa-ab90-403f-b022-550e41053039 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.772508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-01f47fd7-152a-4a97-be2d-3af10f8552b4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:54.784090 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-01f47fd7-152a-4a97-be2d-3af10f8552b4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1578 microversion: 2.1 time: 0.189579 Jan 28 02:01:54.784701 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 394/780] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:54 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:54.801933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f58cfc78-2ce5-46c5-b915-deaafd279f9d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:54.802937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f58cfc78-2ce5-46c5-b915-deaafd279f9d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:54.810827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f58cfc78-2ce5-46c5-b915-deaafd279f9d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.811590 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f58cfc78-2ce5-46c5-b915-deaafd279f9d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.812712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f58cfc78-2ce5-46c5-b915-deaafd279f9d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.813444 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f58cfc78-2ce5-46c5-b915-deaafd279f9d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.862781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-f28177fa-ab90-403f-b022-550e41053039 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lazy-loading 'services' on Instance uuid 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:01:54.958904 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f28177fa-ab90-403f-b022-550e41053039 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "DELETE /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6/os-volume_attachments/760fbdaf-cf9c-4892-860d-74bbbdcea13e" status: 202 len: 0 microversion: 2.1 time: 0.233844 Jan 28 02:01:54.963188 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 387/781] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:01:54 2022] DELETE /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6/os-volume_attachments/760fbdaf-cf9c-4892-860d-74bbbdcea13e => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:01:54.969571 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a4c25343-3a3d-4735-8853-fcba32bee7d1 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:54.970683 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a4c25343-3a3d-4735-8853-fcba32bee7d1 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:54.978409 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a4c25343-3a3d-4735-8853-fcba32bee7d1 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.979873 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a4c25343-3a3d-4735-8853-fcba32bee7d1 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:54.980904 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a4c25343-3a3d-4735-8853-fcba32bee7d1 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:54.981513 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a4c25343-3a3d-4735-8853-fcba32bee7d1 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.780568 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f58cfc78-2ce5-46c5-b915-deaafd279f9d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 1.982514 Jan 28 02:01:56.783612 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 395/782] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:01:54 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:56.788836 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2b713f03-6575-440b-95df-7c65ac5c26de tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:56.789899 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2b713f03-6575-440b-95df-7c65ac5c26de tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:56.798662 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2b713f03-6575-440b-95df-7c65ac5c26de tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.799140 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2b713f03-6575-440b-95df-7c65ac5c26de tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.799934 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2b713f03-6575-440b-95df-7c65ac5c26de tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:56.800366 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2b713f03-6575-440b-95df-7c65ac5c26de tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:56.835562 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a4c25343-3a3d-4735-8853-fcba32bee7d1 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28668 microversion: 2.1 time: 1.869639 Jan 28 02:01:56.836837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 388/783] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:54 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28668 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:57.016911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2b713f03-6575-440b-95df-7c65ac5c26de tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:57.024556 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2b713f03-6575-440b-95df-7c65ac5c26de tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1578 microversion: 2.1 time: 0.241704 Jan 28 02:01:57.025165 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 396/784] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:56 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:57.795653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-601c43ef-09f1-41c0-babd-5526c960906f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:57.797833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-601c43ef-09f1-41c0-babd-5526c960906f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:57.817264 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-601c43ef-09f1-41c0-babd-5526c960906f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.818006 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-601c43ef-09f1-41c0-babd-5526c960906f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.819752 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-601c43ef-09f1-41c0-babd-5526c960906f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.820614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-601c43ef-09f1-41c0-babd-5526c960906f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.850708 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4948ce09-e0a1-45ac-8aa9-4c2a3fbadd8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:57.852285 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4948ce09-e0a1-45ac-8aa9-4c2a3fbadd8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:57.859234 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4948ce09-e0a1-45ac-8aa9-4c2a3fbadd8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.859679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4948ce09-e0a1-45ac-8aa9-4c2a3fbadd8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.860457 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4948ce09-e0a1-45ac-8aa9-4c2a3fbadd8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:57.860913 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4948ce09-e0a1-45ac-8aa9-4c2a3fbadd8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:57.963098 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-601c43ef-09f1-41c0-babd-5526c960906f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 0.174578 Jan 28 02:01:57.967216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 389/785] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:01:57 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:58.000569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4948ce09-e0a1-45ac-8aa9-4c2a3fbadd8a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 28668 microversion: 2.1 time: 0.152426 Jan 28 02:01:58.005711 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 397/786] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:57 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 28668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:58.044849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b44fdc27-42c6-4516-863d-4040346f1818 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:58.045565 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b44fdc27-42c6-4516-863d-4040346f1818 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:58.052661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b44fdc27-42c6-4516-863d-4040346f1818 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.053147 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b44fdc27-42c6-4516-863d-4040346f1818 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.053951 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b44fdc27-42c6-4516-863d-4040346f1818 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.054382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b44fdc27-42c6-4516-863d-4040346f1818 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.262297 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-34d254dc-de96-4ab5-a4ca-9f37f72acef6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:58.263595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-34d254dc-de96-4ab5-a4ca-9f37f72acef6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:58.273583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-34d254dc-de96-4ab5-a4ca-9f37f72acef6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.275101 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-34d254dc-de96-4ab5-a4ca-9f37f72acef6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.281299 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b44fdc27-42c6-4516-863d-4040346f1818 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:58.285471 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-34d254dc-de96-4ab5-a4ca-9f37f72acef6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.289483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-34d254dc-de96-4ab5-a4ca-9f37f72acef6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.290900 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b44fdc27-42c6-4516-863d-4040346f1818 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1510 microversion: 2.1 time: 0.251546 Jan 28 02:01:58.293568 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 390/787] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:58 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:58.320343 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-34d254dc-de96-4ab5-a4ca-9f37f72acef6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:01:58.449217 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-34d254dc-de96-4ab5-a4ca-9f37f72acef6 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "DELETE /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 204 len: 0 microversion: 2.1 time: 0.190543 Jan 28 02:01:58.455348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 398/788] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:01:58 2022] DELETE /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:01:58.461435 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bb5fa2fd-59d1-4c36-bebb-c6b7c7572b4f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:58.462052 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bb5fa2fd-59d1-4c36-bebb-c6b7c7572b4f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:58.473417 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb5fa2fd-59d1-4c36-bebb-c6b7c7572b4f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.473873 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb5fa2fd-59d1-4c36-bebb-c6b7c7572b4f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.475634 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb5fa2fd-59d1-4c36-bebb-c6b7c7572b4f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.476439 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb5fa2fd-59d1-4c36-bebb-c6b7c7572b4f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.489965 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-eab23fe1-e369-4f5c-a5fb-64e4b9938f03 req-99728480-02d6-47bb-97ab-384380bc5ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95db6794-9e5c-4a0e-a565-cdf17c8174c5", "name": "network-vif-deleted", "tag": "a96061fe-84a7-4238-9f60-3ee0a48a23b7"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:58.491421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:58.491421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:01:58.498540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-eab23fe1-e369-4f5c-a5fb-64e4b9938f03 req-99728480-02d6-47bb-97ab-384380bc5ba0 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.498990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-eab23fe1-e369-4f5c-a5fb-64e4b9938f03 req-99728480-02d6-47bb-97ab-384380bc5ba0 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.510578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-eab23fe1-e369-4f5c-a5fb-64e4b9938f03 req-99728480-02d6-47bb-97ab-384380bc5ba0 service nova] Creating event network-vif-deleted:a96061fe-84a7-4238-9f60-3ee0a48a23b7 for instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 on hv-cinder-82497 Jan 28 02:01:58.515839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-eab23fe1-e369-4f5c-a5fb-64e4b9938f03 req-99728480-02d6-47bb-97ab-384380bc5ba0 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029963 Jan 28 02:01:58.516817 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 399/789] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:01:58.724365 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bb5fa2fd-59d1-4c36-bebb-c6b7c7572b4f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:58.733332 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bb5fa2fd-59d1-4c36-bebb-c6b7c7572b4f tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1514 microversion: 2.1 time: 0.276659 Jan 28 02:01:58.733908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 391/790] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:58 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:58.975463 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8a51a8f2-d863-4da9-83f6-0f150ab885f3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:58.976567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8a51a8f2-d863-4da9-83f6-0f150ab885f3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:58.983010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a51a8f2-d863-4da9-83f6-0f150ab885f3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.983538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a51a8f2-d863-4da9-83f6-0f150ab885f3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:58.984387 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a51a8f2-d863-4da9-83f6-0f150ab885f3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:58.984928 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a51a8f2-d863-4da9-83f6-0f150ab885f3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.013823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7d1cfa5e-b390-4b12-89ac-e50e552ec34b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:01:59.014943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7d1cfa5e-b390-4b12-89ac-e50e552ec34b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:59.020991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d1cfa5e-b390-4b12-89ac-e50e552ec34b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.021489 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d1cfa5e-b390-4b12-89ac-e50e552ec34b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.022272 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d1cfa5e-b390-4b12-89ac-e50e552ec34b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.022763 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d1cfa5e-b390-4b12-89ac-e50e552ec34b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.093129 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8a51a8f2-d863-4da9-83f6-0f150ab885f3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 0.121316 Jan 28 02:01:59.093839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 400/791] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:01:58 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:01:59.134662 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7d1cfa5e-b390-4b12-89ac-e50e552ec34b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 30109 microversion: 2.1 time: 0.124770 Jan 28 02:01:59.136231 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 392/792] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:01:59 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 30109 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:01:59.312416 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:59.313148 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:59.319851 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.320318 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.321189 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.321631 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.355936 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.356390 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.357062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lazy-loading 'fault' on Instance uuid 95db6794-9e5c-4a0e-a565-cdf17c8174c5 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:01:59.400322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:59.408856 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a9182237-ceb9-45cb-a493-fa383499ffcb tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 200 len: 1230 microversion: 2.1 time: 0.103134 Jan 28 02:01:59.409481 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 401/793] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:59 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:01:59.751634 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-af12814f-2b48-4d0f-8296-3136f6443e14 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:01:59.752361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-af12814f-2b48-4d0f-8296-3136f6443e14 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:01:59.759401 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af12814f-2b48-4d0f-8296-3136f6443e14 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.759850 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af12814f-2b48-4d0f-8296-3136f6443e14 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.760925 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af12814f-2b48-4d0f-8296-3136f6443e14 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:01:59.761477 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af12814f-2b48-4d0f-8296-3136f6443e14 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:01:59.903565 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-af12814f-2b48-4d0f-8296-3136f6443e14 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:01:59.911194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-af12814f-2b48-4d0f-8296-3136f6443e14 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1514 microversion: 2.1 time: 0.164295 Jan 28 02:01:59.911693 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 393/794] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:01:59 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:00.104547 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dc6648d6-ab32-4af6-a030-50fe4a622ed2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:00.105490 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dc6648d6-ab32-4af6-a030-50fe4a622ed2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:00.111389 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc6648d6-ab32-4af6-a030-50fe4a622ed2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.111831 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc6648d6-ab32-4af6-a030-50fe4a622ed2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.112620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc6648d6-ab32-4af6-a030-50fe4a622ed2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.113086 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc6648d6-ab32-4af6-a030-50fe4a622ed2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.147243 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-01163241-0feb-4537-8d9d-160ca58206ac tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:00.148141 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-01163241-0feb-4537-8d9d-160ca58206ac tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:00.155142 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01163241-0feb-4537-8d9d-160ca58206ac tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.155491 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01163241-0feb-4537-8d9d-160ca58206ac tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.156252 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01163241-0feb-4537-8d9d-160ca58206ac tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.156676 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01163241-0feb-4537-8d9d-160ca58206ac tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.249858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dc6648d6-ab32-4af6-a030-50fe4a622ed2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 0.149433 Jan 28 02:02:00.250515 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 402/795] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:00 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:00.296151 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-01163241-0feb-4537-8d9d-160ca58206ac tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 31430 microversion: 2.1 time: 0.152272 Jan 28 02:02:00.296820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 394/796] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:00 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 31430 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:02:00.426923 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:00.427688 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:00.435327 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.435777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.436569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.437048 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.451927 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] HTTP exception thrown: Instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 could not be found. Jan 28 02:02:00.452524 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Returning 404 to user: Instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:00.453414 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e855f953-fe73-421d-aecd-d7254fcb5b0c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 404 len: 111 microversion: 2.1 time: 0.030798 Jan 28 02:02:00.453977 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 403/797] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:00 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:02:00.549769 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-242115789", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-363378608", "security_groups": [{"name": "tempest-secgroup-smoke-1260954673"}], "block_device_mapping_v2": [{"uuid": "8fa68b2b-0933-4c13-98ce-b0bd05707f92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41f7abf6-a2c1-4ce5-83fe-68e8627532be"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:00.657525 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] validate_networks() for [('41f7abf6-a2c1-4ce5-83fe-68e8627532be', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:02:00.928825 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-32513211-923c-4b70-8a5d-5afc1214836c tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:00.929587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-32513211-923c-4b70-8a5d-5afc1214836c tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:00.936682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32513211-923c-4b70-8a5d-5afc1214836c tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.937160 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32513211-923c-4b70-8a5d-5afc1214836c tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:00.937953 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32513211-923c-4b70-8a5d-5afc1214836c tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:00.938397 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32513211-923c-4b70-8a5d-5afc1214836c tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.231477 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-32513211-923c-4b70-8a5d-5afc1214836c tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:01.242111 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-32513211-923c-4b70-8a5d-5afc1214836c tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1514 microversion: 2.1 time: 0.316911 Jan 28 02:02:01.242929 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 404/798] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:00 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1514 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:01.280649 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:02:01.281447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:02:01.282098 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:02:01.282887 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:02:01.283538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:02:01.298714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.299255 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.301243 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.302209 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.327598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for project 6e15e80496d946b4ba64c95751ebc354. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:02:01.334221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for user cd9cb4ec35524e859b828892c95130e7 and project 6e15e80496d946b4ba64c95751ebc354. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:02:01.409725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-05e6a3e7-111d-43a2-86a8-040dacbeac11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:01.410706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-05e6a3e7-111d-43a2-86a8-040dacbeac11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:01.417853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05e6a3e7-111d-43a2-86a8-040dacbeac11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.418469 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05e6a3e7-111d-43a2-86a8-040dacbeac11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.420056 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05e6a3e7-111d-43a2-86a8-040dacbeac11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.420646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05e6a3e7-111d-43a2-86a8-040dacbeac11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.424503 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:02:01.427619 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fa68b2b-0933-4c13-98ce-b0bd05707f92',volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:02:01.514390 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-05e6a3e7-111d-43a2-86a8-040dacbeac11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 0.256808 Jan 28 02:02:01.515150 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 405/799] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:01 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:01.520518 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-63d83860-7e97-4d17-b092-b9f8f6cfa39f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:01.522106 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-63d83860-7e97-4d17-b092-b9f8f6cfa39f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:01.530147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63d83860-7e97-4d17-b092-b9f8f6cfa39f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.531079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63d83860-7e97-4d17-b092-b9f8f6cfa39f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.532144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63d83860-7e97-4d17-b092-b9f8f6cfa39f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.532858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63d83860-7e97-4d17-b092-b9f8f6cfa39f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.590218 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c5e6a741-2fb1-4bbf-9029-3e7d69d59c7b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.044351 Jan 28 02:02:01.597330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 395/800] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 02:02:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:02:01.602449 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c0ddad59-77ae-4711-85c0-8a5aae3b70e0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:01.603335 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c0ddad59-77ae-4711-85c0-8a5aae3b70e0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:01.637139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-63d83860-7e97-4d17-b092-b9f8f6cfa39f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 33219 microversion: 2.1 time: 0.120343 Jan 28 02:02:01.638481 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 406/801] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:01 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 33219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:02:01.703123 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c0ddad59-77ae-4711-85c0-8a5aae3b70e0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:01.710466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c0ddad59-77ae-4711-85c0-8a5aae3b70e0 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1093 microversion: 2.1 time: 0.111752 Jan 28 02:02:01.711048 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 396/802] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:01 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1093 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:01.760281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-ea726e03-d6c1-46e1-9273-6069b4a0afce req-b3b8ffc1-638b-4366-8fa3-bb7b6a35efbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6", "name": "network-vif-deleted", "tag": "1bc7fefe-60b1-4cd1-929b-b25ada74a928"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:01.761839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:01.761839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:02:01.771222 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ea726e03-d6c1-46e1-9273-6069b4a0afce req-b3b8ffc1-638b-4366-8fa3-bb7b6a35efbc service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:01.771902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ea726e03-d6c1-46e1-9273-6069b4a0afce req-b3b8ffc1-638b-4366-8fa3-bb7b6a35efbc service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:01.797485 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-ea726e03-d6c1-46e1-9273-6069b4a0afce req-b3b8ffc1-638b-4366-8fa3-bb7b6a35efbc service nova] Creating event network-vif-deleted:1bc7fefe-60b1-4cd1-929b-b25ada74a928 for instance 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 on hv-cinder-82497 Jan 28 02:02:01.802827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-ea726e03-d6c1-46e1-9273-6069b4a0afce req-b3b8ffc1-638b-4366-8fa3-bb7b6a35efbc service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046832 Jan 28 02:02:01.803847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 407/803] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:02.264177 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:02.264961 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:02.271321 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.271860 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.272846 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.273386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.307638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.308302 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.308880 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lazy-loading 'fault' on Instance uuid 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:02:02.364549 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4208d3afaa374826b47a3716a2e6d7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf861e434da344c89d039fa373bd0742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:02.372922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ecd19440-f365-4a79-a7e3-517e5b885037 tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 200 len: 1309 microversion: 2.1 time: 0.113737 Jan 28 02:02:02.383484 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 397/804] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:02 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:02.526868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eef9485f-06f8-4cc6-a883-19d7595d897d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:02.527879 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-eef9485f-06f8-4cc6-a883-19d7595d897d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:02.534725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eef9485f-06f8-4cc6-a883-19d7595d897d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.535171 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eef9485f-06f8-4cc6-a883-19d7595d897d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.536129 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eef9485f-06f8-4cc6-a883-19d7595d897d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.536565 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eef9485f-06f8-4cc6-a883-19d7595d897d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.622851 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-eef9485f-06f8-4cc6-a883-19d7595d897d tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 0.100780 Jan 28 02:02:02.623482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 408/805] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:02 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:02.649043 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c8c150fa-8445-4668-9837-484fe3b1754b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:02.650039 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c8c150fa-8445-4668-9837-484fe3b1754b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:02.657245 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8c150fa-8445-4668-9837-484fe3b1754b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.657707 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8c150fa-8445-4668-9837-484fe3b1754b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.658469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8c150fa-8445-4668-9837-484fe3b1754b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.658895 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8c150fa-8445-4668-9837-484fe3b1754b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.728225 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-509df15a-8eb8-44ad-adae-e03d169b2854 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:02.728783 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-509df15a-8eb8-44ad-adae-e03d169b2854 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:02.736045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-509df15a-8eb8-44ad-adae-e03d169b2854 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.736411 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-509df15a-8eb8-44ad-adae-e03d169b2854 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.737517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-509df15a-8eb8-44ad-adae-e03d169b2854 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:02.737957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-509df15a-8eb8-44ad-adae-e03d169b2854 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:02.763674 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c8c150fa-8445-4668-9837-484fe3b1754b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 34060 microversion: 2.1 time: 0.117795 Jan 28 02:02:02.764413 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 398/806] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:02 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 34060 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:02:02.805588 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-509df15a-8eb8-44ad-adae-e03d169b2854 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:02.814076 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-509df15a-8eb8-44ad-adae-e03d169b2854 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1191 microversion: 2.1 time: 0.090123 Jan 28 02:02:02.814651 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 409/807] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:02 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:03.392749 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:03.394182 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] [instance: 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:03.403921 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.404508 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.405609 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.406049 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.420636 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] HTTP exception thrown: Instance 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 could not be found. Jan 28 02:02:03.421295 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] Returning 404 to user: Instance 1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:03.422372 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d3a53f7f-d038-48d3-a48b-c2e02f71085a tempest-VolumesSnapshotTestJSON-1881933145 tempest-VolumesSnapshotTestJSON-1881933145-project] 10.222.0.96 "GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6" status: 404 len: 111 microversion: 2.1 time: 0.034750 Jan 28 02:02:03.422969 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 399/808] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:03 2022] GET /compute/v2.1/servers/1b2dcda6-83c0-43d7-a4e4-a04e5836a7c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:02:03.634557 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1bcff355-9d0d-49c4-9cc4-da55886ea7fd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:03.635649 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1bcff355-9d0d-49c4-9cc4-da55886ea7fd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:03.642687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1bcff355-9d0d-49c4-9cc4-da55886ea7fd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.643174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1bcff355-9d0d-49c4-9cc4-da55886ea7fd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.644042 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1bcff355-9d0d-49c4-9cc4-da55886ea7fd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.644644 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1bcff355-9d0d-49c4-9cc4-da55886ea7fd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.776363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8cb91a64-5797-410f-b51e-7cfb605a4326 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:03.777977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8cb91a64-5797-410f-b51e-7cfb605a4326 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:03.788067 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cb91a64-5797-410f-b51e-7cfb605a4326 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.789420 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cb91a64-5797-410f-b51e-7cfb605a4326 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.797756 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cb91a64-5797-410f-b51e-7cfb605a4326 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.799462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8cb91a64-5797-410f-b51e-7cfb605a4326 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.816009 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1bcff355-9d0d-49c4-9cc4-da55886ea7fd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 0.184225 Jan 28 02:02:03.817106 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 410/809] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:03 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:03.838295 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fd38eadc-e11c-40b4-ab48-0468eef08510 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:03.841066 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fd38eadc-e11c-40b4-ab48-0468eef08510 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:03.859188 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd38eadc-e11c-40b4-ab48-0468eef08510 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.859920 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd38eadc-e11c-40b4-ab48-0468eef08510 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.861475 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd38eadc-e11c-40b4-ab48-0468eef08510 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:03.862407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd38eadc-e11c-40b4-ab48-0468eef08510 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:03.949630 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8cb91a64-5797-410f-b51e-7cfb605a4326 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 35105 microversion: 2.1 time: 0.177498 Jan 28 02:02:03.950922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 400/810] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:03 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 35105 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:02:04.185413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fd38eadc-e11c-40b4-ab48-0468eef08510 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:04.193988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fd38eadc-e11c-40b4-ab48-0468eef08510 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1277 microversion: 2.1 time: 0.363474 Jan 28 02:02:04.194569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 411/811] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:03 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:04.658738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-9ce858c7-afe7-40f2-a5ba-6a4629bf08ab req-49fc4d02-4c56-4a32-86ad-75024926081f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c097440e-be71-4ec9-a745-018fb72e47c8", "tag": "eb1cbd46-e972-417e-b2bd-3fa5d34c1e51"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:04.661693 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:04.661693 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:02:04.671775 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-9ce858c7-afe7-40f2-a5ba-6a4629bf08ab req-49fc4d02-4c56-4a32-86ad-75024926081f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.672554 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-9ce858c7-afe7-40f2-a5ba-6a4629bf08ab req-49fc4d02-4c56-4a32-86ad-75024926081f service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:04.689325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-9ce858c7-afe7-40f2-a5ba-6a4629bf08ab req-49fc4d02-4c56-4a32-86ad-75024926081f service nova] Creating event network-changed:eb1cbd46-e972-417e-b2bd-3fa5d34c1e51 for instance c097440e-be71-4ec9-a745-018fb72e47c8 on hv-cinder-82497 Jan 28 02:02:04.695253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-9ce858c7-afe7-40f2-a5ba-6a4629bf08ab req-49fc4d02-4c56-4a32-86ad-75024926081f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042114 Jan 28 02:02:04.696126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 401/812] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:04.829646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-69dca23e-5ad7-488a-a146-80dadc22dfee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:04.831347 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-69dca23e-5ad7-488a-a146-80dadc22dfee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:04.840891 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69dca23e-5ad7-488a-a146-80dadc22dfee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.841814 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69dca23e-5ad7-488a-a146-80dadc22dfee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:04.842922 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69dca23e-5ad7-488a-a146-80dadc22dfee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.843588 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69dca23e-5ad7-488a-a146-80dadc22dfee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:04.964571 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4a82d8f0-1af2-4018-a4d2-a6e2b016c186 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:04.965682 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4a82d8f0-1af2-4018-a4d2-a6e2b016c186 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:04.980009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a82d8f0-1af2-4018-a4d2-a6e2b016c186 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.980825 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a82d8f0-1af2-4018-a4d2-a6e2b016c186 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:04.982029 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a82d8f0-1af2-4018-a4d2-a6e2b016c186 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:04.982772 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a82d8f0-1af2-4018-a4d2-a6e2b016c186 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:04.989033 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-69dca23e-5ad7-488a-a146-80dadc22dfee tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 14 microversion: 2.20 time: 0.165163 Jan 28 02:02:04.990091 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 412/813] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:04 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:05.086233 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4a82d8f0-1af2-4018-a4d2-a6e2b016c186 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 36406 microversion: 2.1 time: 0.125693 Jan 28 02:02:05.087229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 402/814] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:04 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 36406 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:02:05.211004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1025c415-1684-406a-883a-51de2e36d2c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:05.211744 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1025c415-1684-406a-883a-51de2e36d2c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:05.219041 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1025c415-1684-406a-883a-51de2e36d2c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:05.219495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1025c415-1684-406a-883a-51de2e36d2c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:05.220284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1025c415-1684-406a-883a-51de2e36d2c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:05.220722 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1025c415-1684-406a-883a-51de2e36d2c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:05.366396 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1025c415-1684-406a-883a-51de2e36d2c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:05.374211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1025c415-1684-406a-883a-51de2e36d2c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.167164 Jan 28 02:02:05.374951 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 413/815] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:05 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:06.001721 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-932d37ff-6856-4580-b981-2bffc0dfeb8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:06.002802 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-932d37ff-6856-4580-b981-2bffc0dfeb8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:06.009307 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-932d37ff-6856-4580-b981-2bffc0dfeb8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.009764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-932d37ff-6856-4580-b981-2bffc0dfeb8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:06.011483 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-932d37ff-6856-4580-b981-2bffc0dfeb8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.011933 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-932d37ff-6856-4580-b981-2bffc0dfeb8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:06.099866 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-575b9b12-d94c-4fb6-b3c5-a243ae35416c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:06.100777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-575b9b12-d94c-4fb6-b3c5-a243ae35416c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:06.107092 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-575b9b12-d94c-4fb6-b3c5-a243ae35416c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.107545 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-575b9b12-d94c-4fb6-b3c5-a243ae35416c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:06.108344 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-575b9b12-d94c-4fb6-b3c5-a243ae35416c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:06.108780 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-575b9b12-d94c-4fb6-b3c5-a243ae35416c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:08.027047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-575b9b12-d94c-4fb6-b3c5-a243ae35416c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 38178 microversion: 2.1 time: 1.929682 Jan 28 02:02:08.027984 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 414/816] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:06 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 38178 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:02:08.032730 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8b692d29-3615-4726-96bc-f26bf5538cd8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:08.033446 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8b692d29-3615-4726-96bc-f26bf5538cd8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:08.039826 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b692d29-3615-4726-96bc-f26bf5538cd8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:08.040282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b692d29-3615-4726-96bc-f26bf5538cd8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:08.041085 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b692d29-3615-4726-96bc-f26bf5538cd8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:08.041679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b692d29-3615-4726-96bc-f26bf5538cd8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:08.062235 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-932d37ff-6856-4580-b981-2bffc0dfeb8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 12124 microversion: 2.20 time: 2.064518 Jan 28 02:02:08.065755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 403/817] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:05 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 12124 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:08.265403 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8b692d29-3615-4726-96bc-f26bf5538cd8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:08.272829 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8b692d29-3615-4726-96bc-f26bf5538cd8 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.243901 Jan 28 02:02:08.273364 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 415/818] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:08 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:09.039589 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f36748b4-75ff-401c-afb6-a8ec6d06e09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:09.040591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f36748b4-75ff-401c-afb6-a8ec6d06e09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:09.048347 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f36748b4-75ff-401c-afb6-a8ec6d06e09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.048952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f36748b4-75ff-401c-afb6-a8ec6d06e09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.049791 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f36748b4-75ff-401c-afb6-a8ec6d06e09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.050424 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f36748b4-75ff-401c-afb6-a8ec6d06e09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.073986 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fd23c88b-ae32-4e9e-9437-04fb4d7fcdd8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:09.074951 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fd23c88b-ae32-4e9e-9437-04fb4d7fcdd8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:09.082153 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd23c88b-ae32-4e9e-9437-04fb4d7fcdd8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.082620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd23c88b-ae32-4e9e-9437-04fb4d7fcdd8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.083636 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd23c88b-ae32-4e9e-9437-04fb4d7fcdd8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.084074 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd23c88b-ae32-4e9e-9437-04fb4d7fcdd8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.174240 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f36748b4-75ff-401c-afb6-a8ec6d06e09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 38178 microversion: 2.1 time: 0.138108 Jan 28 02:02:09.175268 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 404/819] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:09 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 38178 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:02:09.208752 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fd23c88b-ae32-4e9e-9437-04fb4d7fcdd8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 17861 microversion: 2.20 time: 0.138509 Jan 28 02:02:09.209345 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 416/820] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:09 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 17861 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:09.294353 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c8c194fd-b398-427f-a58f-43edf703fa1a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:09.295762 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c8c194fd-b398-427f-a58f-43edf703fa1a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:09.303044 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8c194fd-b398-427f-a58f-43edf703fa1a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.303506 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8c194fd-b398-427f-a58f-43edf703fa1a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.304856 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8c194fd-b398-427f-a58f-43edf703fa1a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:09.305377 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8c194fd-b398-427f-a58f-43edf703fa1a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:09.450800 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c8c194fd-b398-427f-a58f-43edf703fa1a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:09.458548 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c8c194fd-b398-427f-a58f-43edf703fa1a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.171358 Jan 28 02:02:09.459193 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 405/821] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:09 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:10.187851 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e032f7fa-4815-4531-ac91-7dcf72548822 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:10.189946 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e032f7fa-4815-4531-ac91-7dcf72548822 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:10.199742 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e032f7fa-4815-4531-ac91-7dcf72548822 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.200532 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e032f7fa-4815-4531-ac91-7dcf72548822 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.202341 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e032f7fa-4815-4531-ac91-7dcf72548822 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.203223 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e032f7fa-4815-4531-ac91-7dcf72548822 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.220417 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ff11e5de-409d-4d98-b638-e9b5cfc47efa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:10.222572 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ff11e5de-409d-4d98-b638-e9b5cfc47efa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:10.230272 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff11e5de-409d-4d98-b638-e9b5cfc47efa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.231016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff11e5de-409d-4d98-b638-e9b5cfc47efa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.232016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff11e5de-409d-4d98-b638-e9b5cfc47efa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.232860 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff11e5de-409d-4d98-b638-e9b5cfc47efa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.324461 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e032f7fa-4815-4531-ac91-7dcf72548822 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 38198 microversion: 2.1 time: 0.141294 Jan 28 02:02:10.326039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 417/822] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:10 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 38198 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:02:10.366330 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ff11e5de-409d-4d98-b638-e9b5cfc47efa tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 18208 microversion: 2.20 time: 0.149907 Jan 28 02:02:10.366992 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 406/823] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:10 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 18208 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:10.476850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-613655c8-09ae-401f-a2a6-822f3d37ebf4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:10.477638 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-613655c8-09ae-401f-a2a6-822f3d37ebf4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:10.485008 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-613655c8-09ae-401f-a2a6-822f3d37ebf4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.485461 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-613655c8-09ae-401f-a2a6-822f3d37ebf4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.486235 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-613655c8-09ae-401f-a2a6-822f3d37ebf4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:10.486674 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-613655c8-09ae-401f-a2a6-822f3d37ebf4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:10.616850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-613655c8-09ae-401f-a2a6-822f3d37ebf4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:10.625334 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-613655c8-09ae-401f-a2a6-822f3d37ebf4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.152534 Jan 28 02:02:10.625864 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 418/824] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:10 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:11.336395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c4d1a433-7698-4598-a266-0acaabd38d84 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:11.337423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c4d1a433-7698-4598-a266-0acaabd38d84 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:11.343955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4d1a433-7698-4598-a266-0acaabd38d84 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.344400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4d1a433-7698-4598-a266-0acaabd38d84 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.345204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4d1a433-7698-4598-a266-0acaabd38d84 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.345640 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4d1a433-7698-4598-a266-0acaabd38d84 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.382747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-18fa8918-00e4-44ad-890f-68ee75fabbfe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:11.382747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-18fa8918-00e4-44ad-890f-68ee75fabbfe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:11.384365 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-18fa8918-00e4-44ad-890f-68ee75fabbfe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.384932 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-18fa8918-00e4-44ad-890f-68ee75fabbfe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.386521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-18fa8918-00e4-44ad-890f-68ee75fabbfe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.386925 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-18fa8918-00e4-44ad-890f-68ee75fabbfe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.445847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c4d1a433-7698-4598-a266-0acaabd38d84 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 200 len: 38307 microversion: 2.1 time: 0.113230 Jan 28 02:02:11.446696 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 407/825] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:11 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 38307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:02:11.457498 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fbdd83a2-3fb9-46cc-aceb-093a478805a3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:11.457886 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fbdd83a2-3fb9-46cc-aceb-093a478805a3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:11.464362 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbdd83a2-3fb9-46cc-aceb-093a478805a3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.464821 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbdd83a2-3fb9-46cc-aceb-093a478805a3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.465635 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbdd83a2-3fb9-46cc-aceb-093a478805a3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.466050 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbdd83a2-3fb9-46cc-aceb-093a478805a3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.492072 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fbdd83a2-3fb9-46cc-aceb-093a478805a3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/ips" status: 200 len: 146 microversion: 2.1 time: 0.038750 Jan 28 02:02:11.498611 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 408/826] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Jan 28 02:02:11 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:11.519908 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-18fa8918-00e4-44ad-890f-68ee75fabbfe tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 20267 microversion: 2.20 time: 0.145629 Jan 28 02:02:11.520566 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 419/827] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:11 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 20267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:11.643719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-38d3c82b-5318-46e8-9fb8-c3f3454a93d5 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:11.644679 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-38d3c82b-5318-46e8-9fb8-c3f3454a93d5 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:11.650604 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38d3c82b-5318-46e8-9fb8-c3f3454a93d5 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.651042 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38d3c82b-5318-46e8-9fb8-c3f3454a93d5 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.651822 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38d3c82b-5318-46e8-9fb8-c3f3454a93d5 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:11.652288 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38d3c82b-5318-46e8-9fb8-c3f3454a93d5 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:11.785231 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-38d3c82b-5318-46e8-9fb8-c3f3454a93d5 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:11.793736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-38d3c82b-5318-46e8-9fb8-c3f3454a93d5 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.153760 Jan 28 02:02:11.794309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 409/828] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:11 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:12.533071 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-632d7c5b-740a-4f0b-8dc1-2f6a100df91f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:12.534467 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-632d7c5b-740a-4f0b-8dc1-2f6a100df91f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:12.540997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-632d7c5b-740a-4f0b-8dc1-2f6a100df91f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:12.542413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-632d7c5b-740a-4f0b-8dc1-2f6a100df91f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:12.543387 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-632d7c5b-740a-4f0b-8dc1-2f6a100df91f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:12.543828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-632d7c5b-740a-4f0b-8dc1-2f6a100df91f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:12.670390 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-632d7c5b-740a-4f0b-8dc1-2f6a100df91f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 22771 microversion: 2.20 time: 0.141454 Jan 28 02:02:12.671070 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 420/829] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:12 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 22771 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:12.811324 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d4e599e5-01a2-4448-904d-5340c35acc24 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:12.811932 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d4e599e5-01a2-4448-904d-5340c35acc24 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:12.818191 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4e599e5-01a2-4448-904d-5340c35acc24 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:12.818634 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4e599e5-01a2-4448-904d-5340c35acc24 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:12.819400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4e599e5-01a2-4448-904d-5340c35acc24 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:12.819838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4e599e5-01a2-4448-904d-5340c35acc24 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:12.943444 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d4e599e5-01a2-4448-904d-5340c35acc24 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:12.951586 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d4e599e5-01a2-4448-904d-5340c35acc24 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.144145 Jan 28 02:02:12.952147 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 410/830] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:12 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:13.683161 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9c15f829-9f2b-48e2-ae3f-a5cb59752318 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:13.684180 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9c15f829-9f2b-48e2-ae3f-a5cb59752318 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:13.691647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c15f829-9f2b-48e2-ae3f-a5cb59752318 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:13.692100 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c15f829-9f2b-48e2-ae3f-a5cb59752318 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:13.693105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c15f829-9f2b-48e2-ae3f-a5cb59752318 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:13.693703 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c15f829-9f2b-48e2-ae3f-a5cb59752318 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:13.748511 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ed7eb112-c5cf-4fd7-b561-50dabcba2163 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df45659d-49c3-4479-9ddf-5d43b10804bd"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:13.749702 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ed7eb112-c5cf-4fd7-b561-50dabcba2163 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:13.756411 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed7eb112-c5cf-4fd7-b561-50dabcba2163 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:13.757101 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed7eb112-c5cf-4fd7-b561-50dabcba2163 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:13.758060 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed7eb112-c5cf-4fd7-b561-50dabcba2163 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:13.758510 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed7eb112-c5cf-4fd7-b561-50dabcba2163 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.289515 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9c15f829-9f2b-48e2-ae3f-a5cb59752318 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 27022 microversion: 2.20 time: 2.610776 Jan 28 02:02:16.290374 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 421/831] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:13 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 27022 bytes in 2613 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:16.296488 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6eb720a5-1910-40de-bb71-0e322db4c675 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:16.297313 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6eb720a5-1910-40de-bb71-0e322db4c675 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:16.304620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6eb720a5-1910-40de-bb71-0e322db4c675 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.305193 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6eb720a5-1910-40de-bb71-0e322db4c675 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.306049 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6eb720a5-1910-40de-bb71-0e322db4c675 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:16.306561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6eb720a5-1910-40de-bb71-0e322db4c675 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:16.466679 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ed7eb112-c5cf-4fd7-b561-50dabcba2163 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.722439 Jan 28 02:02:16.471862 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 411/832] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 02:02:13 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/os-volume_attachments => generated 194 bytes in 2724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:02:16.525016 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6eb720a5-1910-40de-bb71-0e322db4c675 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:16.538518 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6eb720a5-1910-40de-bb71-0e322db4c675 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.246976 Jan 28 02:02:16.539593 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 422/833] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:16 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:17.306254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b3c294d0-3627-47b6-ad92-3287afa4a07a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:17.308658 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b3c294d0-3627-47b6-ad92-3287afa4a07a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:17.315528 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3c294d0-3627-47b6-ad92-3287afa4a07a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.316093 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3c294d0-3627-47b6-ad92-3287afa4a07a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.316985 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3c294d0-3627-47b6-ad92-3287afa4a07a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.317491 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3c294d0-3627-47b6-ad92-3287afa4a07a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.447133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b3c294d0-3627-47b6-ad92-3287afa4a07a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 27632 microversion: 2.20 time: 0.147268 Jan 28 02:02:17.450005 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 412/834] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:17 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 27632 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:17.558747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7fe9cf91-3d4c-4d60-be5b-466b9f11bb46 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:17.559370 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7fe9cf91-3d4c-4d60-be5b-466b9f11bb46 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:17.566551 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7fe9cf91-3d4c-4d60-be5b-466b9f11bb46 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.567007 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7fe9cf91-3d4c-4d60-be5b-466b9f11bb46 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.567799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7fe9cf91-3d4c-4d60-be5b-466b9f11bb46 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:17.568421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7fe9cf91-3d4c-4d60-be5b-466b9f11bb46 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:17.712190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7fe9cf91-3d4c-4d60-be5b-466b9f11bb46 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:17.720768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7fe9cf91-3d4c-4d60-be5b-466b9f11bb46 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.166513 Jan 28 02:02:17.721485 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 423/835] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:17 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:18.460348 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e574e483-1d24-4251-acef-c204d609fc23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:18.461369 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e574e483-1d24-4251-acef-c204d609fc23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:18.469433 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e574e483-1d24-4251-acef-c204d609fc23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:18.469881 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e574e483-1d24-4251-acef-c204d609fc23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:18.470660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e574e483-1d24-4251-acef-c204d609fc23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:18.471257 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e574e483-1d24-4251-acef-c204d609fc23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:18.573533 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e574e483-1d24-4251-acef-c204d609fc23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 27990 microversion: 2.20 time: 0.116407 Jan 28 02:02:18.577573 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 413/836] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:18 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 27990 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:18.598473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1533994645", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "216c658f-3a84-47a3-9118-0286fb62e503"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:18.653097 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] validate_networks() for [('216c658f-3a84-47a3-9118-0286fb62e503', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:02:18.739155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a12a5b33-3bbb-4e28-abf2-e8addc004912 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:18.740048 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a12a5b33-3bbb-4e28-abf2-e8addc004912 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:18.747041 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a12a5b33-3bbb-4e28-abf2-e8addc004912 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:18.747763 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a12a5b33-3bbb-4e28-abf2-e8addc004912 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:18.748542 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a12a5b33-3bbb-4e28-abf2-e8addc004912 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:18.749162 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a12a5b33-3bbb-4e28-abf2-e8addc004912 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:18.946876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a12a5b33-3bbb-4e28-abf2-e8addc004912 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:18.964591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a12a5b33-3bbb-4e28-abf2-e8addc004912 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.229563 Jan 28 02:02:18.966899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 414/837] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:18 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:19.109134 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:02:19.109611 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:02:19.110132 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:02:19.110525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:02:19.110931 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:02:19.120161 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:19.120859 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:19.121647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:19.122074 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:19.139164 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Getting quotas for project b8a50f8f8ee4469a9314f34a5b30e53f. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:02:19.143131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Getting quotas for user 63df08c6076844ab853626d2cf658dd9 and project b8a50f8f8ee4469a9314f34a5b30e53f. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:02:19.153883 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:02:19.156482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:02:19.203348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0b25e412-9e15-4e9b-aaa5-389586b4c548 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608697 Jan 28 02:02:19.203983 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 424/838] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 02:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:02:19.213880 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b64a4301-f80a-4bc1-aeee-7bb90797b284 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:19.214496 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b64a4301-f80a-4bc1-aeee-7bb90797b284 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:19.271536 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b64a4301-f80a-4bc1-aeee-7bb90797b284 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:19.280842 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b64a4301-f80a-4bc1-aeee-7bb90797b284 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1214 microversion: 2.1 time: 0.069428 Jan 28 02:02:19.281820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 415/839] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:19 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:19.585643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-970bba80-dc58-4866-8b56-8b7e25a2d525 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:19.586591 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-970bba80-dc58-4866-8b56-8b7e25a2d525 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:19.595061 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-970bba80-dc58-4866-8b56-8b7e25a2d525 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:19.595721 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-970bba80-dc58-4866-8b56-8b7e25a2d525 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:19.596471 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-970bba80-dc58-4866-8b56-8b7e25a2d525 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:19.597051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-970bba80-dc58-4866-8b56-8b7e25a2d525 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:19.715907 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-970bba80-dc58-4866-8b56-8b7e25a2d525 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 28244 microversion: 2.20 time: 0.134611 Jan 28 02:02:19.716615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 425/840] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:19 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 28244 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:19.981612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-42083e11-536b-4f10-84e5-1eabdccf9a4e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:19.982180 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-42083e11-536b-4f10-84e5-1eabdccf9a4e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:19.988509 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-42083e11-536b-4f10-84e5-1eabdccf9a4e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:19.989011 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-42083e11-536b-4f10-84e5-1eabdccf9a4e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:19.989781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-42083e11-536b-4f10-84e5-1eabdccf9a4e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:19.990214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-42083e11-536b-4f10-84e5-1eabdccf9a4e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.119584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-42083e11-536b-4f10-84e5-1eabdccf9a4e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:20.127267 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-42083e11-536b-4f10-84e5-1eabdccf9a4e tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.149662 Jan 28 02:02:20.127933 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 416/841] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:19 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:20.299919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-46ea0954-38dc-4135-9cce-bee5576c56e5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:20.300637 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-46ea0954-38dc-4135-9cce-bee5576c56e5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:20.308733 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-46ea0954-38dc-4135-9cce-bee5576c56e5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.309211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-46ea0954-38dc-4135-9cce-bee5576c56e5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.310176 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-46ea0954-38dc-4135-9cce-bee5576c56e5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.310717 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-46ea0954-38dc-4135-9cce-bee5576c56e5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.419196 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-46ea0954-38dc-4135-9cce-bee5576c56e5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:20.427529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-46ea0954-38dc-4135-9cce-bee5576c56e5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1274 microversion: 2.1 time: 0.132357 Jan 28 02:02:20.428122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 426/842] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:20 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:20.729454 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f86b1a46-6998-49fb-8c0a-e347818e92ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:20.730740 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f86b1a46-6998-49fb-8c0a-e347818e92ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:20.737447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f86b1a46-6998-49fb-8c0a-e347818e92ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.737447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f86b1a46-6998-49fb-8c0a-e347818e92ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.738204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f86b1a46-6998-49fb-8c0a-e347818e92ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.738638 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f86b1a46-6998-49fb-8c0a-e347818e92ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.839138 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-1d51df54-2aef-482f-a007-2a0ee7080283 req-9a2f0003-5e26-4433-a1f2-d493a5309359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c097440e-be71-4ec9-a745-018fb72e47c8", "name": "network-vif-plugged", "status": "completed", "tag": "eb1cbd46-e972-417e-b2bd-3fa5d34c1e51"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:20.840548 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f86b1a46-6998-49fb-8c0a-e347818e92ec tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 28244 microversion: 2.20 time: 0.115938 Jan 28 02:02:20.841057 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:20.841057 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:02:20.841657 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 417/843] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:20 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 28244 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:20.849526 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-1d51df54-2aef-482f-a007-2a0ee7080283 req-9a2f0003-5e26-4433-a1f2-d493a5309359 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:20.850243 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-1d51df54-2aef-482f-a007-2a0ee7080283 req-9a2f0003-5e26-4433-a1f2-d493a5309359 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:20.864028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-1d51df54-2aef-482f-a007-2a0ee7080283 req-9a2f0003-5e26-4433-a1f2-d493a5309359 service nova] Creating event network-vif-plugged:eb1cbd46-e972-417e-b2bd-3fa5d34c1e51 for instance c097440e-be71-4ec9-a745-018fb72e47c8 on hv-cinder-82497 Jan 28 02:02:20.869705 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-1d51df54-2aef-482f-a007-2a0ee7080283 req-9a2f0003-5e26-4433-a1f2-d493a5309359 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035712 Jan 28 02:02:20.870314 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 427/844] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:02:21.149563 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7435fb4e-5277-438d-bf4d-8d2faf4b933d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:21.150994 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7435fb4e-5277-438d-bf4d-8d2faf4b933d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:21.158660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7435fb4e-5277-438d-bf4d-8d2faf4b933d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.160857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7435fb4e-5277-438d-bf4d-8d2faf4b933d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.160857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7435fb4e-5277-438d-bf4d-8d2faf4b933d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.160857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7435fb4e-5277-438d-bf4d-8d2faf4b933d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.445821 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9ae3764d-e2ad-4cde-8d5b-465470eb6a40 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:21.446455 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9ae3764d-e2ad-4cde-8d5b-465470eb6a40 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:21.453595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9ae3764d-e2ad-4cde-8d5b-465470eb6a40 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.454038 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9ae3764d-e2ad-4cde-8d5b-465470eb6a40 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.454827 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9ae3764d-e2ad-4cde-8d5b-465470eb6a40 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.455267 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9ae3764d-e2ad-4cde-8d5b-465470eb6a40 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.718389 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7435fb4e-5277-438d-bf4d-8d2faf4b933d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:21.725736 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7435fb4e-5277-438d-bf4d-8d2faf4b933d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.580494 Jan 28 02:02:21.726321 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 418/845] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:21 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:21.812931 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9ae3764d-e2ad-4cde-8d5b-465470eb6a40 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:21.820637 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9ae3764d-e2ad-4cde-8d5b-465470eb6a40 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1314 microversion: 2.1 time: 0.379464 Jan 28 02:02:21.821234 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 428/846] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:21 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:21.851467 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0858409a-fa9f-4b4e-a268-cf10386da042 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:21.852456 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0858409a-fa9f-4b4e-a268-cf10386da042 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:21.858869 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0858409a-fa9f-4b4e-a268-cf10386da042 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.859312 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0858409a-fa9f-4b4e-a268-cf10386da042 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.860088 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0858409a-fa9f-4b4e-a268-cf10386da042 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:21.860523 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0858409a-fa9f-4b4e-a268-cf10386da042 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:21.969236 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0858409a-fa9f-4b4e-a268-cf10386da042 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 28535 microversion: 2.20 time: 0.121202 Jan 28 02:02:21.969885 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 419/847] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:21 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 28535 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:22.372231 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-cd3cd67e-005e-4105-94aa-cb8263cb5ccf req-5b8734d4-39d2-49d0-be07-c6c8004aa550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a052804-a0e1-412b-b2db-388b1b60496e", "tag": "6492dcec-3bc1-4433-99e2-471ef9d5a6b5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:22.373983 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:22.373983 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:02:22.380947 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-cd3cd67e-005e-4105-94aa-cb8263cb5ccf req-5b8734d4-39d2-49d0-be07-c6c8004aa550 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.381474 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-cd3cd67e-005e-4105-94aa-cb8263cb5ccf req-5b8734d4-39d2-49d0-be07-c6c8004aa550 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.397803 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-cd3cd67e-005e-4105-94aa-cb8263cb5ccf req-5b8734d4-39d2-49d0-be07-c6c8004aa550 service nova] Creating event network-changed:6492dcec-3bc1-4433-99e2-471ef9d5a6b5 for instance 9a052804-a0e1-412b-b2db-388b1b60496e on hv-cinder-82497 Jan 28 02:02:22.404147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-cd3cd67e-005e-4105-94aa-cb8263cb5ccf req-5b8734d4-39d2-49d0-be07-c6c8004aa550 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162913 Jan 28 02:02:22.405820 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 429/848] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:22.742379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d19c990a-31ee-4aad-8388-ce4cdab656c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:22.743075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d19c990a-31ee-4aad-8388-ce4cdab656c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:22.750533 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d19c990a-31ee-4aad-8388-ce4cdab656c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.750982 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d19c990a-31ee-4aad-8388-ce4cdab656c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.751758 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d19c990a-31ee-4aad-8388-ce4cdab656c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.752194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d19c990a-31ee-4aad-8388-ce4cdab656c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.839269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-467720b5-3d57-46fd-b6b9-561b520d83a5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:22.840079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-467720b5-3d57-46fd-b6b9-561b520d83a5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:22.849305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-467720b5-3d57-46fd-b6b9-561b520d83a5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.850014 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-467720b5-3d57-46fd-b6b9-561b520d83a5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.850928 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-467720b5-3d57-46fd-b6b9-561b520d83a5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.851441 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-467720b5-3d57-46fd-b6b9-561b520d83a5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.882133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d19c990a-31ee-4aad-8388-ce4cdab656c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:22.896419 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d19c990a-31ee-4aad-8388-ce4cdab656c3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1265 microversion: 2.1 time: 0.157743 Jan 28 02:02:22.897577 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 420/849] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:22 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:22.980922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c572e5c5-aba9-4661-b3ac-8a3cb89089ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:22.981859 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c572e5c5-aba9-4661-b3ac-8a3cb89089ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:22.989020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c572e5c5-aba9-4661-b3ac-8a3cb89089ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.989396 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c572e5c5-aba9-4661-b3ac-8a3cb89089ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:22.990188 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c572e5c5-aba9-4661-b3ac-8a3cb89089ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:22.990631 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c572e5c5-aba9-4661-b3ac-8a3cb89089ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:23.034660 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-467720b5-3d57-46fd-b6b9-561b520d83a5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:23.041999 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-467720b5-3d57-46fd-b6b9-561b520d83a5 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1314 microversion: 2.1 time: 0.207600 Jan 28 02:02:23.042565 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 430/850] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:22 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:23.124768 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c572e5c5-aba9-4661-b3ac-8a3cb89089ba tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 28535 microversion: 2.20 time: 0.147509 Jan 28 02:02:23.125446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 421/851] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:22 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 28535 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:23.921301 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f1970122-3738-4628-a7e6-3a4ffca419bd tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:23.922248 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f1970122-3738-4628-a7e6-3a4ffca419bd tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:23.928144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1970122-3738-4628-a7e6-3a4ffca419bd tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:23.928587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1970122-3738-4628-a7e6-3a4ffca419bd tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:23.929387 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1970122-3738-4628-a7e6-3a4ffca419bd tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:23.929823 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1970122-3738-4628-a7e6-3a4ffca419bd tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.058953 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-21c47a3b-22e7-42f5-a9c5-801e00bb5d2e tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:24.059753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-21c47a3b-22e7-42f5-a9c5-801e00bb5d2e tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:24.066042 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f1970122-3738-4628-a7e6-3a4ffca419bd tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:24.066408 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21c47a3b-22e7-42f5-a9c5-801e00bb5d2e tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.067095 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21c47a3b-22e7-42f5-a9c5-801e00bb5d2e tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.068132 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21c47a3b-22e7-42f5-a9c5-801e00bb5d2e tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.068651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21c47a3b-22e7-42f5-a9c5-801e00bb5d2e tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.075312 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f1970122-3738-4628-a7e6-3a4ffca419bd tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1452 microversion: 2.1 time: 0.157892 Jan 28 02:02:24.075878 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 431/852] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:23 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:24.085518 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-36d1412b-d2bb-4c8e-b3b8-04288826c01c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:24.092656 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-36d1412b-d2bb-4c8e-b3b8-04288826c01c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.093137 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-36d1412b-d2bb-4c8e-b3b8-04288826c01c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.158527 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-36d1412b-d2bb-4c8e-b3b8-04288826c01c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Going to try to stop instance {{(pid=115798) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Jan 28 02:02:24.202403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-21c47a3b-22e7-42f5-a9c5-801e00bb5d2e tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:24.206811 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-36d1412b-d2bb-4c8e-b3b8-04288826c01c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 202 len: 0 microversion: 2.1 time: 0.124681 Jan 28 02:02:24.207985 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 432/853] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:24 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:24.211391 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-21c47a3b-22e7-42f5-a9c5-801e00bb5d2e tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1314 microversion: 2.1 time: 0.156396 Jan 28 02:02:24.214714 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dace7801-d8e3-4b5c-a97d-cca6f05cead7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:24.215444 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dace7801-d8e3-4b5c-a97d-cca6f05cead7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:24.221830 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 422/854] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:24 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:24.222186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dace7801-d8e3-4b5c-a97d-cca6f05cead7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.222711 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dace7801-d8e3-4b5c-a97d-cca6f05cead7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.223653 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dace7801-d8e3-4b5c-a97d-cca6f05cead7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.224113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dace7801-d8e3-4b5c-a97d-cca6f05cead7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.227372 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-54dd83b0-0690-48d5-83da-721fd3e7d3d9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:24.228853 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-54dd83b0-0690-48d5-83da-721fd3e7d3d9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:24.234771 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54dd83b0-0690-48d5-83da-721fd3e7d3d9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.235221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54dd83b0-0690-48d5-83da-721fd3e7d3d9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.236001 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54dd83b0-0690-48d5-83da-721fd3e7d3d9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.236444 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54dd83b0-0690-48d5-83da-721fd3e7d3d9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.353088 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-54dd83b0-0690-48d5-83da-721fd3e7d3d9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 28703 microversion: 2.20 time: 0.129606 Jan 28 02:02:24.354612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 423/855] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:24 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 28703 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:24.359753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a2d854ab-dcbd-4ccd-926d-02550503e03a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:24.360455 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a2d854ab-dcbd-4ccd-926d-02550503e03a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:24.367003 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2d854ab-dcbd-4ccd-926d-02550503e03a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.367448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2d854ab-dcbd-4ccd-926d-02550503e03a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.368221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2d854ab-dcbd-4ccd-926d-02550503e03a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:24.368658 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2d854ab-dcbd-4ccd-926d-02550503e03a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:24.370254 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dace7801-d8e3-4b5c-a97d-cca6f05cead7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:24.377944 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dace7801-d8e3-4b5c-a97d-cca6f05cead7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1452 microversion: 2.1 time: 0.169035 Jan 28 02:02:24.378521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 433/856] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:24 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:24.522484 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a2d854ab-dcbd-4ccd-926d-02550503e03a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:24.536270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a2d854ab-dcbd-4ccd-926d-02550503e03a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.180234 Jan 28 02:02:24.536864 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 424/857] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:24 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:25.229216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-57ba238f-9b92-4b64-bda9-cf97c30228fc tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:25.229845 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-57ba238f-9b92-4b64-bda9-cf97c30228fc tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:25.235731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57ba238f-9b92-4b64-bda9-cf97c30228fc tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.236176 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57ba238f-9b92-4b64-bda9-cf97c30228fc tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.236975 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57ba238f-9b92-4b64-bda9-cf97c30228fc tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.237406 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57ba238f-9b92-4b64-bda9-cf97c30228fc tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.364517 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-50536ca7-bcd8-4694-939f-dcf227b4ec88 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:25.365470 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-50536ca7-bcd8-4694-939f-dcf227b4ec88 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:25.367131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-57ba238f-9b92-4b64-bda9-cf97c30228fc tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:25.374099 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50536ca7-bcd8-4694-939f-dcf227b4ec88 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.374841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50536ca7-bcd8-4694-939f-dcf227b4ec88 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.376278 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50536ca7-bcd8-4694-939f-dcf227b4ec88 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.376918 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50536ca7-bcd8-4694-939f-dcf227b4ec88 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.378720 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-57ba238f-9b92-4b64-bda9-cf97c30228fc tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1314 microversion: 2.1 time: 0.153695 Jan 28 02:02:25.388102 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 434/858] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:25 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:25.490246 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-50536ca7-bcd8-4694-939f-dcf227b4ec88 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 28703 microversion: 2.20 time: 0.129217 Jan 28 02:02:25.491030 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 425/859] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:25 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 28703 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:25.553631 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ba15945e-48e9-4f02-8eda-9334e366b494 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:25.554253 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ba15945e-48e9-4f02-8eda-9334e366b494 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:25.561774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ba15945e-48e9-4f02-8eda-9334e366b494 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.562230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ba15945e-48e9-4f02-8eda-9334e366b494 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.563027 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ba15945e-48e9-4f02-8eda-9334e366b494 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:25.563465 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ba15945e-48e9-4f02-8eda-9334e366b494 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:25.658851 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:02:25.659061 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: Fri Jan 28 02:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 (ip 10.222.0.96) !!! Jan 28 02:02:25.694483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ba15945e-48e9-4f02-8eda-9334e366b494 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:25.703602 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ba15945e-48e9-4f02-8eda-9334e366b494 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.153579 Jan 28 02:02:25.704192 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 435/860] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:25 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:26.377896 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-2292a091-26b9-4777-b4e0-117c0e563d18 req-a33e4692-0f86-4ffe-ab86-4fb926ff4c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c097440e-be71-4ec9-a745-018fb72e47c8", "tag": "eb1cbd46-e972-417e-b2bd-3fa5d34c1e51"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:26.379890 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:26.379890 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:02:26.387404 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-2292a091-26b9-4777-b4e0-117c0e563d18 req-a33e4692-0f86-4ffe-ab86-4fb926ff4c23 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.387839 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-2292a091-26b9-4777-b4e0-117c0e563d18 req-a33e4692-0f86-4ffe-ab86-4fb926ff4c23 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.396448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-668f371b-3fdd-4ddc-b45d-0b2b24a8bc35 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:26.397150 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-668f371b-3fdd-4ddc-b45d-0b2b24a8bc35 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:26.399426 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-2292a091-26b9-4777-b4e0-117c0e563d18 req-a33e4692-0f86-4ffe-ab86-4fb926ff4c23 service nova] Creating event network-changed:eb1cbd46-e972-417e-b2bd-3fa5d34c1e51 for instance c097440e-be71-4ec9-a745-018fb72e47c8 on hv-cinder-82497 Jan 28 02:02:26.404687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-668f371b-3fdd-4ddc-b45d-0b2b24a8bc35 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.405726 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-668f371b-3fdd-4ddc-b45d-0b2b24a8bc35 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.405980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-2292a091-26b9-4777-b4e0-117c0e563d18 req-a33e4692-0f86-4ffe-ab86-4fb926ff4c23 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105274 Jan 28 02:02:26.406517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-668f371b-3fdd-4ddc-b45d-0b2b24a8bc35 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.406884 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 426/861] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:02:26.407080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-668f371b-3fdd-4ddc-b45d-0b2b24a8bc35 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.503737 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4f5090ac-5dd0-4610-a153-d02cd2ceda11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:26.504667 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4f5090ac-5dd0-4610-a153-d02cd2ceda11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:26.513441 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f5090ac-5dd0-4610-a153-d02cd2ceda11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.514069 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f5090ac-5dd0-4610-a153-d02cd2ceda11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.515073 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f5090ac-5dd0-4610-a153-d02cd2ceda11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.515670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f5090ac-5dd0-4610-a153-d02cd2ceda11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.616824 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4f5090ac-5dd0-4610-a153-d02cd2ceda11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 28703 microversion: 2.20 time: 0.117472 Jan 28 02:02:26.617483 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 427/862] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:26 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 28703 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:26.643327 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-668f371b-3fdd-4ddc-b45d-0b2b24a8bc35 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:26.651234 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-668f371b-3fdd-4ddc-b45d-0b2b24a8bc35 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1314 microversion: 2.1 time: 0.258940 Jan 28 02:02:26.651919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 436/863] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:26 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:26.721891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-347d7246-2190-4171-9502-7cd7e8e328b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:26.722665 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-347d7246-2190-4171-9502-7cd7e8e328b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:26.731007 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-347d7246-2190-4171-9502-7cd7e8e328b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.731457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-347d7246-2190-4171-9502-7cd7e8e328b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.732238 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-347d7246-2190-4171-9502-7cd7e8e328b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:26.732667 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-347d7246-2190-4171-9502-7cd7e8e328b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:26.925057 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-347d7246-2190-4171-9502-7cd7e8e328b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:26.933728 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-347d7246-2190-4171-9502-7cd7e8e328b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.215820 Jan 28 02:02:26.943832 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 428/864] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:26 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:27.086538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-1a2f9c4f-6f41-449c-985d-46572abd2085 req-5f0de0e1-ffb3-4aca-9dbd-26307c767206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a052804-a0e1-412b-b2db-388b1b60496e", "name": "network-vif-plugged", "status": "completed", "tag": "6492dcec-3bc1-4433-99e2-471ef9d5a6b5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:27.088712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:27.088712 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:02:27.099796 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-1a2f9c4f-6f41-449c-985d-46572abd2085 req-5f0de0e1-ffb3-4aca-9dbd-26307c767206 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.101032 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-1a2f9c4f-6f41-449c-985d-46572abd2085 req-5f0de0e1-ffb3-4aca-9dbd-26307c767206 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.121250 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-1a2f9c4f-6f41-449c-985d-46572abd2085 req-5f0de0e1-ffb3-4aca-9dbd-26307c767206 service nova] Creating event network-vif-plugged:6492dcec-3bc1-4433-99e2-471ef9d5a6b5 for instance 9a052804-a0e1-412b-b2db-388b1b60496e on hv-cinder-82497 Jan 28 02:02:27.129749 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-1a2f9c4f-6f41-449c-985d-46572abd2085 req-5f0de0e1-ffb3-4aca-9dbd-26307c767206 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046752 Jan 28 02:02:27.132992 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 437/865] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:27.633668 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4a975fd9-588c-47b7-88a7-841af0a6297a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:27.635922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4a975fd9-588c-47b7-88a7-841af0a6297a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:27.643841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a975fd9-588c-47b7-88a7-841af0a6297a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.644295 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a975fd9-588c-47b7-88a7-841af0a6297a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.647916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a975fd9-588c-47b7-88a7-841af0a6297a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.647916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4a975fd9-588c-47b7-88a7-841af0a6297a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.670875 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a1df66ed-9a3d-4ffa-9a5c-9a070e298a91 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:27.671627 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a1df66ed-9a3d-4ffa-9a5c-9a070e298a91 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:27.678216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1df66ed-9a3d-4ffa-9a5c-9a070e298a91 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.678920 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1df66ed-9a3d-4ffa-9a5c-9a070e298a91 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.679708 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1df66ed-9a3d-4ffa-9a5c-9a070e298a91 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.680338 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1df66ed-9a3d-4ffa-9a5c-9a070e298a91 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.817112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a1df66ed-9a3d-4ffa-9a5c-9a070e298a91 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:27.826740 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a1df66ed-9a3d-4ffa-9a5c-9a070e298a91 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1314 microversion: 2.1 time: 0.160937 Jan 28 02:02:27.827342 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 438/866] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:27 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:27.896509 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4a975fd9-588c-47b7-88a7-841af0a6297a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 28703 microversion: 2.20 time: 0.270016 Jan 28 02:02:27.901645 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 429/867] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:27 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 28703 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:27.957055 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-afc7d28e-b0a4-463a-8897-e9bdb080c0be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:27.957864 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-afc7d28e-b0a4-463a-8897-e9bdb080c0be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:27.967041 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afc7d28e-b0a4-463a-8897-e9bdb080c0be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.967492 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afc7d28e-b0a4-463a-8897-e9bdb080c0be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:27.968277 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afc7d28e-b0a4-463a-8897-e9bdb080c0be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:27.968725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afc7d28e-b0a4-463a-8897-e9bdb080c0be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.110705 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-afc7d28e-b0a4-463a-8897-e9bdb080c0be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:28.119521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-afc7d28e-b0a4-463a-8897-e9bdb080c0be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.170189 Jan 28 02:02:28.120108 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 439/868] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:27 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:28.844227 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-520ef12e-4ab6-474e-ae3c-9728b23ab4d4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:28.844891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-520ef12e-4ab6-474e-ae3c-9728b23ab4d4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:28.851820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-520ef12e-4ab6-474e-ae3c-9728b23ab4d4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.852755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-520ef12e-4ab6-474e-ae3c-9728b23ab4d4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.853083 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-520ef12e-4ab6-474e-ae3c-9728b23ab4d4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.854087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-520ef12e-4ab6-474e-ae3c-9728b23ab4d4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.909767 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9dbc970b-e2ed-4d12-b6f6-5bd9b901e8f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:28.910730 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9dbc970b-e2ed-4d12-b6f6-5bd9b901e8f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:28.917325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dbc970b-e2ed-4d12-b6f6-5bd9b901e8f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.917771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dbc970b-e2ed-4d12-b6f6-5bd9b901e8f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.918625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dbc970b-e2ed-4d12-b6f6-5bd9b901e8f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:28.919059 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9dbc970b-e2ed-4d12-b6f6-5bd9b901e8f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:28.984122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-520ef12e-4ab6-474e-ae3c-9728b23ab4d4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:28.991615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-520ef12e-4ab6-474e-ae3c-9728b23ab4d4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1498 microversion: 2.1 time: 0.151566 Jan 28 02:02:28.992182 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 430/869] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:28 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:29.035725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9dbc970b-e2ed-4d12-b6f6-5bd9b901e8f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 29478 microversion: 2.20 time: 0.130254 Jan 28 02:02:29.038459 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 440/870] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:28 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 29478 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:29.142922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-96016736-b19e-45b0-9851-14ce4646de5c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:29.143454 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-96016736-b19e-45b0-9851-14ce4646de5c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:29.149214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96016736-b19e-45b0-9851-14ce4646de5c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.149670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96016736-b19e-45b0-9851-14ce4646de5c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.151041 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96016736-b19e-45b0-9851-14ce4646de5c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.151447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96016736-b19e-45b0-9851-14ce4646de5c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.284021 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-96016736-b19e-45b0-9851-14ce4646de5c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:29.292051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-96016736-b19e-45b0-9851-14ce4646de5c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.153275 Jan 28 02:02:29.292617 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 431/871] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:29 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:29.701570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9fcd3ab1-43df-4f34-b38b-79b424482754 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:29.702147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9fcd3ab1-43df-4f34-b38b-79b424482754 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:29.708957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9fcd3ab1-43df-4f34-b38b-79b424482754 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.709402 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9fcd3ab1-43df-4f34-b38b-79b424482754 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.710173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9fcd3ab1-43df-4f34-b38b-79b424482754 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.710601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9fcd3ab1-43df-4f34-b38b-79b424482754 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.736497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9fcd3ab1-43df-4f34-b38b-79b424482754 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:02:29.812682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9fcd3ab1-43df-4f34-b38b-79b424482754 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 204 len: 0 microversion: 2.1 time: 0.114976 Jan 28 02:02:29.813354 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 441/872] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:02:29 2022] DELETE /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:02:29.821198 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b4930fdc-ceaa-4d6b-97fc-ca13b13aad48 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:29.821825 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b4930fdc-ceaa-4d6b-97fc-ca13b13aad48 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:29.827719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4930fdc-ceaa-4d6b-97fc-ca13b13aad48 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.828167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4930fdc-ceaa-4d6b-97fc-ca13b13aad48 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.829000 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4930fdc-ceaa-4d6b-97fc-ca13b13aad48 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:29.829461 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4930fdc-ceaa-4d6b-97fc-ca13b13aad48 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:29.951302 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b4930fdc-ceaa-4d6b-97fc-ca13b13aad48 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:29.958622 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b4930fdc-ceaa-4d6b-97fc-ca13b13aad48 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1504 microversion: 2.1 time: 0.141087 Jan 28 02:02:29.959196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 432/873] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:29 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1504 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:30.048720 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9f70a4d8-afe2-4be9-b11b-386abacaeae2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:30.049774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9f70a4d8-afe2-4be9-b11b-386abacaeae2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:30.055580 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f70a4d8-afe2-4be9-b11b-386abacaeae2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.056034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f70a4d8-afe2-4be9-b11b-386abacaeae2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.056868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f70a4d8-afe2-4be9-b11b-386abacaeae2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.057359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f70a4d8-afe2-4be9-b11b-386abacaeae2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.172759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9f70a4d8-afe2-4be9-b11b-386abacaeae2 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 31208 microversion: 2.20 time: 0.127972 Jan 28 02:02:30.173436 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 442/874] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:30 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 31208 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:30.308840 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1621f5fa-411a-46a2-a745-04463c42c149 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:30.309454 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1621f5fa-411a-46a2-a745-04463c42c149 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:30.315331 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1621f5fa-411a-46a2-a745-04463c42c149 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.315788 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1621f5fa-411a-46a2-a745-04463c42c149 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.316562 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1621f5fa-411a-46a2-a745-04463c42c149 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.317034 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1621f5fa-411a-46a2-a745-04463c42c149 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.437089 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1621f5fa-411a-46a2-a745-04463c42c149 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:30.444763 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1621f5fa-411a-46a2-a745-04463c42c149 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.139666 Jan 28 02:02:30.445353 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 433/875] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:30 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:30.976361 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3056cced-f109-430d-8e90-b583fdd86a1a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:30.977190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3056cced-f109-430d-8e90-b583fdd86a1a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:30.983990 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3056cced-f109-430d-8e90-b583fdd86a1a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.984462 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3056cced-f109-430d-8e90-b583fdd86a1a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:30.985263 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3056cced-f109-430d-8e90-b583fdd86a1a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:30.985704 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3056cced-f109-430d-8e90-b583fdd86a1a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.112760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3056cced-f109-430d-8e90-b583fdd86a1a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:31.120544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3056cced-f109-430d-8e90-b583fdd86a1a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1504 microversion: 2.1 time: 0.148139 Jan 28 02:02:31.121163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 443/876] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:30 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:31.185191 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9f899389-337a-49a4-b32c-494b6731a4d6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:31.186103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9f899389-337a-49a4-b32c-494b6731a4d6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:31.192251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f899389-337a-49a4-b32c-494b6731a4d6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.192692 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f899389-337a-49a4-b32c-494b6731a4d6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.193490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f899389-337a-49a4-b32c-494b6731a4d6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.193926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f899389-337a-49a4-b32c-494b6731a4d6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.318758 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9f899389-337a-49a4-b32c-494b6731a4d6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 32643 microversion: 2.20 time: 0.137299 Jan 28 02:02:31.319328 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 434/877] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:31 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 32643 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:31.462761 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2bb0e59d-637d-452e-96da-4ad4aaf6a628 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:31.463730 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2bb0e59d-637d-452e-96da-4ad4aaf6a628 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:31.469718 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bb0e59d-637d-452e-96da-4ad4aaf6a628 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.470163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bb0e59d-637d-452e-96da-4ad4aaf6a628 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.470939 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bb0e59d-637d-452e-96da-4ad4aaf6a628 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:31.471376 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bb0e59d-637d-452e-96da-4ad4aaf6a628 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:31.602193 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2bb0e59d-637d-452e-96da-4ad4aaf6a628 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:31.610456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2bb0e59d-637d-452e-96da-4ad4aaf6a628 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.151376 Jan 28 02:02:31.611037 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 444/878] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:31 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:32.138064 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-85b35d4d-ca71-4351-bd6e-ef01dd22c883 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:32.138749 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-85b35d4d-ca71-4351-bd6e-ef01dd22c883 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:32.145790 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85b35d4d-ca71-4351-bd6e-ef01dd22c883 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.146244 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85b35d4d-ca71-4351-bd6e-ef01dd22c883 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.147038 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85b35d4d-ca71-4351-bd6e-ef01dd22c883 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.147504 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85b35d4d-ca71-4351-bd6e-ef01dd22c883 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.221216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-85b35d4d-ca71-4351-bd6e-ef01dd22c883 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:32.230180 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-85b35d4d-ca71-4351-bd6e-ef01dd22c883 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 200 len: 1462 microversion: 2.1 time: 0.095041 Jan 28 02:02:32.230906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 435/879] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:32 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:32.272898 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-2a2792b6-7997-47e6-bea7-5359125f9ca1 req-8bab6c8f-3e08-4571-91b8-19e370b9975a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a052804-a0e1-412b-b2db-388b1b60496e", "name": "network-vif-deleted", "tag": "6492dcec-3bc1-4433-99e2-471ef9d5a6b5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:32.274658 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:32.274658 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:02:32.283288 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-2a2792b6-7997-47e6-bea7-5359125f9ca1 req-8bab6c8f-3e08-4571-91b8-19e370b9975a service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.283728 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-2a2792b6-7997-47e6-bea7-5359125f9ca1 req-8bab6c8f-3e08-4571-91b8-19e370b9975a service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.296286 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-2a2792b6-7997-47e6-bea7-5359125f9ca1 req-8bab6c8f-3e08-4571-91b8-19e370b9975a service nova] Creating event network-vif-deleted:6492dcec-3bc1-4433-99e2-471ef9d5a6b5 for instance 9a052804-a0e1-412b-b2db-388b1b60496e on hv-cinder-82497 Jan 28 02:02:32.301599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-2a2792b6-7997-47e6-bea7-5359125f9ca1 req-8bab6c8f-3e08-4571-91b8-19e370b9975a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032160 Jan 28 02:02:32.302604 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 445/880] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:32.331399 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3ea43038-f030-486f-9627-6a710314fd4f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:32.332301 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3ea43038-f030-486f-9627-6a710314fd4f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:32.338445 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ea43038-f030-486f-9627-6a710314fd4f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.338888 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ea43038-f030-486f-9627-6a710314fd4f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.339660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ea43038-f030-486f-9627-6a710314fd4f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.340088 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ea43038-f030-486f-9627-6a710314fd4f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.450363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3ea43038-f030-486f-9627-6a710314fd4f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 33598 microversion: 2.20 time: 0.122375 Jan 28 02:02:32.450946 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 436/881] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:32 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 33598 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:32.629583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3920a423-a9a2-485c-a609-bdf815b4bb83 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:32.630278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3920a423-a9a2-485c-a609-bdf815b4bb83 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:32.637709 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3920a423-a9a2-485c-a609-bdf815b4bb83 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.638158 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3920a423-a9a2-485c-a609-bdf815b4bb83 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.641494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3920a423-a9a2-485c-a609-bdf815b4bb83 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:32.641494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3920a423-a9a2-485c-a609-bdf815b4bb83 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:32.767006 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3920a423-a9a2-485c-a609-bdf815b4bb83 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:32.776035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3920a423-a9a2-485c-a609-bdf815b4bb83 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.149871 Jan 28 02:02:32.776613 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 446/882] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:32 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:33.248094 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:33.248814 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9a052804-a0e1-412b-b2db-388b1b60496e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:33.255615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.256062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.256846 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.257283 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.270459 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] HTTP exception thrown: Instance 9a052804-a0e1-412b-b2db-388b1b60496e could not be found. Jan 28 02:02:33.271039 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Returning 404 to user: Instance 9a052804-a0e1-412b-b2db-388b1b60496e could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:33.271852 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2c341fe8-9d3f-40c8-a19f-d819e2bc7b7a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e" status: 404 len: 111 microversion: 2.1 time: 0.028808 Jan 28 02:02:33.272387 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 437/883] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:33 2022] GET /compute/v2.1/servers/9a052804-a0e1-412b-b2db-388b1b60496e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:02:33.364384 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1884754782", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "networks": [{"uuid": "216c658f-3a84-47a3-9118-0286fb62e503"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:33.418697 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] validate_networks() for [('216c658f-3a84-47a3-9118-0286fb62e503', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:02:33.462133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d40e0bf3-c8a0-4217-a06e-d3fce5c0daa1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:33.464182 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d40e0bf3-c8a0-4217-a06e-d3fce5c0daa1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:33.470280 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d40e0bf3-c8a0-4217-a06e-d3fce5c0daa1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.470722 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d40e0bf3-c8a0-4217-a06e-d3fce5c0daa1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.471502 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d40e0bf3-c8a0-4217-a06e-d3fce5c0daa1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.471941 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d40e0bf3-c8a0-4217-a06e-d3fce5c0daa1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.579779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d40e0bf3-c8a0-4217-a06e-d3fce5c0daa1 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 34613 microversion: 2.20 time: 0.121378 Jan 28 02:02:33.580427 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 438/884] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:33 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 34613 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:33.763125 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:02:33.763579 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:02:33.764052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:02:33.764455 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:02:33.764901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:02:33.773914 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.774351 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.775233 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.775734 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.793288 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Getting quotas for project b8a50f8f8ee4469a9314f34a5b30e53f. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:02:33.794095 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c26b79eb-e978-4ccb-bf75-42d135bcb1e5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:33.794805 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c26b79eb-e978-4ccb-bf75-42d135bcb1e5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:33.798644 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Getting quotas for user 63df08c6076844ab853626d2cf658dd9 and project b8a50f8f8ee4469a9314f34a5b30e53f. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:02:33.801684 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c26b79eb-e978-4ccb-bf75-42d135bcb1e5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.802140 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c26b79eb-e978-4ccb-bf75-42d135bcb1e5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.803108 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c26b79eb-e978-4ccb-bf75-42d135bcb1e5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:33.803678 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c26b79eb-e978-4ccb-bf75-42d135bcb1e5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:33.815188 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:02:33.817574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:02:33.880596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-63c29824-55ea-4b3a-8eb4-4a6236910630 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519844 Jan 28 02:02:33.887505 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 447/885] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 02:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:02:33.893831 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bad6b92f-177c-4a0b-9658-146ca5b4fffa tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:33.894895 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bad6b92f-177c-4a0b-9658-146ca5b4fffa tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:33.960321 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bad6b92f-177c-4a0b-9658-146ca5b4fffa tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:33.967863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bad6b92f-177c-4a0b-9658-146ca5b4fffa tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1214 microversion: 2.1 time: 0.078564 Jan 28 02:02:33.968767 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 448/886] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:33 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:33.975845 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c26b79eb-e978-4ccb-bf75-42d135bcb1e5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:33.985170 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c26b79eb-e978-4ccb-bf75-42d135bcb1e5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.195347 Jan 28 02:02:33.985750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 439/887] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:33 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:34.591911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ff05ec6e-c07c-45ec-bef5-ba026e4b0535 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:34.592917 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ff05ec6e-c07c-45ec-bef5-ba026e4b0535 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:34.601282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff05ec6e-c07c-45ec-bef5-ba026e4b0535 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:34.601735 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff05ec6e-c07c-45ec-bef5-ba026e4b0535 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:34.602517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff05ec6e-c07c-45ec-bef5-ba026e4b0535 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:34.602947 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff05ec6e-c07c-45ec-bef5-ba026e4b0535 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:34.714211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ff05ec6e-c07c-45ec-bef5-ba026e4b0535 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 35617 microversion: 2.20 time: 0.126118 Jan 28 02:02:34.715562 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 449/888] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:34 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 35617 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:34.985428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-098fb108-3ed1-4c63-a618-660c6a72caec tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:34.986168 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-098fb108-3ed1-4c63-a618-660c6a72caec tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:34.992424 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-098fb108-3ed1-4c63-a618-660c6a72caec tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:34.992905 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-098fb108-3ed1-4c63-a618-660c6a72caec tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:34.993693 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-098fb108-3ed1-4c63-a618-660c6a72caec tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:34.994850 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-098fb108-3ed1-4c63-a618-660c6a72caec tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:35.003791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c450d830-e41a-42d6-ac66-c88768bdf526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:35.004595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c450d830-e41a-42d6-ac66-c88768bdf526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:35.011524 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c450d830-e41a-42d6-ac66-c88768bdf526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:35.012054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c450d830-e41a-42d6-ac66-c88768bdf526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:35.012863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c450d830-e41a-42d6-ac66-c88768bdf526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:35.013303 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c450d830-e41a-42d6-ac66-c88768bdf526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:35.062240 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-098fb108-3ed1-4c63-a618-660c6a72caec tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:35.069835 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-098fb108-3ed1-4c63-a618-660c6a72caec tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1274 microversion: 2.1 time: 0.088093 Jan 28 02:02:35.070715 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 440/889] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:34 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:35.243574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c450d830-e41a-42d6-ac66-c88768bdf526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:35.252251 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c450d830-e41a-42d6-ac66-c88768bdf526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.252489 Jan 28 02:02:35.252901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 450/890] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:34 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:35.726109 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5956ecd9-e4b2-4cb4-8920-9cb091bf02db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:35.727245 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5956ecd9-e4b2-4cb4-8920-9cb091bf02db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:35.734207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5956ecd9-e4b2-4cb4-8920-9cb091bf02db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:35.734665 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5956ecd9-e4b2-4cb4-8920-9cb091bf02db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:35.735633 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5956ecd9-e4b2-4cb4-8920-9cb091bf02db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:35.736253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5956ecd9-e4b2-4cb4-8920-9cb091bf02db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:35.863804 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5956ecd9-e4b2-4cb4-8920-9cb091bf02db tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 36848 microversion: 2.20 time: 0.141207 Jan 28 02:02:35.864449 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 441/891] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:35 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 36848 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:36.086693 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-062daecb-d63f-49a1-a07e-2a0fe2166172 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:36.088599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-062daecb-d63f-49a1-a07e-2a0fe2166172 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:36.095223 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-062daecb-d63f-49a1-a07e-2a0fe2166172 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.095757 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-062daecb-d63f-49a1-a07e-2a0fe2166172 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.096616 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-062daecb-d63f-49a1-a07e-2a0fe2166172 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.097138 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-062daecb-d63f-49a1-a07e-2a0fe2166172 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.270712 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fd52f7ac-418b-4e94-a58a-6aa69a90781c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:36.271406 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fd52f7ac-418b-4e94-a58a-6aa69a90781c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:36.278476 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd52f7ac-418b-4e94-a58a-6aa69a90781c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.278924 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd52f7ac-418b-4e94-a58a-6aa69a90781c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.279690 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd52f7ac-418b-4e94-a58a-6aa69a90781c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.280123 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd52f7ac-418b-4e94-a58a-6aa69a90781c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.311280 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-062daecb-d63f-49a1-a07e-2a0fe2166172 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:36.321223 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-062daecb-d63f-49a1-a07e-2a0fe2166172 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1314 microversion: 2.1 time: 0.238153 Jan 28 02:02:36.321956 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 451/892] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:36 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:36.493075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fd52f7ac-418b-4e94-a58a-6aa69a90781c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:36.502430 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fd52f7ac-418b-4e94-a58a-6aa69a90781c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.235957 Jan 28 02:02:36.503027 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 442/893] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:36 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:36.876553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eeda7f0d-eb57-4348-b742-a90be853851b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:36.877541 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-eeda7f0d-eb57-4348-b742-a90be853851b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:36.883472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eeda7f0d-eb57-4348-b742-a90be853851b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.883927 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eeda7f0d-eb57-4348-b742-a90be853851b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.885300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eeda7f0d-eb57-4348-b742-a90be853851b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.885816 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eeda7f0d-eb57-4348-b742-a90be853851b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.890830 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-a642aa11-e285-449b-a524-530997e8838e req-f633e8dd-cb9a-4e5d-9126-9fab27508e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb5a503-0fc9-4510-a086-3273a19837e9", "tag": "3400fbc1-29c5-4e24-87ed-c5731f87a36a"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:36.892977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:36.892977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:02:36.906713 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-a642aa11-e285-449b-a524-530997e8838e req-f633e8dd-cb9a-4e5d-9126-9fab27508e13 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:36.907176 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-a642aa11-e285-449b-a524-530997e8838e req-f633e8dd-cb9a-4e5d-9126-9fab27508e13 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:36.919810 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-a642aa11-e285-449b-a524-530997e8838e req-f633e8dd-cb9a-4e5d-9126-9fab27508e13 service nova] Creating event network-changed:3400fbc1-29c5-4e24-87ed-c5731f87a36a for instance 9cb5a503-0fc9-4510-a086-3273a19837e9 on hv-cinder-82497 Jan 28 02:02:36.924496 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-a642aa11-e285-449b-a524-530997e8838e req-f633e8dd-cb9a-4e5d-9126-9fab27508e13 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043787 Jan 28 02:02:36.925146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 443/894] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:37.003582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-eeda7f0d-eb57-4348-b742-a90be853851b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 38028 microversion: 2.20 time: 0.130535 Jan 28 02:02:37.007642 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 452/895] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:36 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 38028 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:37.339531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5d6d205c-8981-46ff-b064-97a3b3b114d8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:37.340224 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5d6d205c-8981-46ff-b064-97a3b3b114d8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:37.346218 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d6d205c-8981-46ff-b064-97a3b3b114d8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.346664 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d6d205c-8981-46ff-b064-97a3b3b114d8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.347440 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d6d205c-8981-46ff-b064-97a3b3b114d8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.347870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d6d205c-8981-46ff-b064-97a3b3b114d8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.507841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5d6d205c-8981-46ff-b064-97a3b3b114d8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:37.515329 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5d6d205c-8981-46ff-b064-97a3b3b114d8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1314 microversion: 2.1 time: 0.180883 Jan 28 02:02:37.515891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 444/896] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:37 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:37.519865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f91c6c7a-7246-406e-9566-ef670d142d30 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:37.520574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f91c6c7a-7246-406e-9566-ef670d142d30 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:37.528198 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f91c6c7a-7246-406e-9566-ef670d142d30 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.528938 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f91c6c7a-7246-406e-9566-ef670d142d30 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.529727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f91c6c7a-7246-406e-9566-ef670d142d30 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:37.530238 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f91c6c7a-7246-406e-9566-ef670d142d30 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:37.745018 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f91c6c7a-7246-406e-9566-ef670d142d30 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:37.752861 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f91c6c7a-7246-406e-9566-ef670d142d30 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.236964 Jan 28 02:02:37.753433 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 453/897] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:37 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:38.015726 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e16212ab-bdf1-4e21-b609-0d2f657b9336 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:38.016560 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e16212ab-bdf1-4e21-b609-0d2f657b9336 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:38.022283 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e16212ab-bdf1-4e21-b609-0d2f657b9336 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.022732 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e16212ab-bdf1-4e21-b609-0d2f657b9336 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.023496 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e16212ab-bdf1-4e21-b609-0d2f657b9336 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.023933 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e16212ab-bdf1-4e21-b609-0d2f657b9336 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.122483 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e16212ab-bdf1-4e21-b609-0d2f657b9336 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 38242 microversion: 2.20 time: 0.110356 Jan 28 02:02:38.123281 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 445/898] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:38 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 38242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:38.532513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e1d3a1ce-535f-446c-942f-0df7c576699d tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:38.533132 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e1d3a1ce-535f-446c-942f-0df7c576699d tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:38.539567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e1d3a1ce-535f-446c-942f-0df7c576699d tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.540021 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e1d3a1ce-535f-446c-942f-0df7c576699d tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.541051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e1d3a1ce-535f-446c-942f-0df7c576699d tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.541573 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e1d3a1ce-535f-446c-942f-0df7c576699d tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.671429 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e1d3a1ce-535f-446c-942f-0df7c576699d tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:38.678748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e1d3a1ce-535f-446c-942f-0df7c576699d tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1314 microversion: 2.1 time: 0.150187 Jan 28 02:02:38.679320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 454/899] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:38 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:38.770909 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ba2454b6-8098-44b1-904e-43fd5426771e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:38.771584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ba2454b6-8098-44b1-904e-43fd5426771e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:38.778841 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba2454b6-8098-44b1-904e-43fd5426771e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.779358 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba2454b6-8098-44b1-904e-43fd5426771e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.780063 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba2454b6-8098-44b1-904e-43fd5426771e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:38.780750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba2454b6-8098-44b1-904e-43fd5426771e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:38.906621 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ba2454b6-8098-44b1-904e-43fd5426771e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:38.915661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ba2454b6-8098-44b1-904e-43fd5426771e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1722 microversion: 2.1 time: 0.148772 Jan 28 02:02:38.916270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 446/900] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:38 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:39.135915 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eb48238a-2388-40d3-9753-aae2730a05e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:39.136750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-eb48238a-2388-40d3-9753-aae2730a05e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:39.142747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eb48238a-2388-40d3-9753-aae2730a05e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:39.143198 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eb48238a-2388-40d3-9753-aae2730a05e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:39.143966 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eb48238a-2388-40d3-9753-aae2730a05e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:39.144401 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eb48238a-2388-40d3-9753-aae2730a05e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:39.234960 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-eb48238a-2388-40d3-9753-aae2730a05e9 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 38242 microversion: 2.20 time: 0.103641 Jan 28 02:02:39.235614 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 455/901] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:39 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 38242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:39.695131 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a9f6bbf3-baff-45af-9e45-e1c9ffc25218 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:39.695738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a9f6bbf3-baff-45af-9e45-e1c9ffc25218 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:39.703031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9f6bbf3-baff-45af-9e45-e1c9ffc25218 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:39.703557 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9f6bbf3-baff-45af-9e45-e1c9ffc25218 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:39.704339 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9f6bbf3-baff-45af-9e45-e1c9ffc25218 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:39.704776 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9f6bbf3-baff-45af-9e45-e1c9ffc25218 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:39.830475 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a9f6bbf3-baff-45af-9e45-e1c9ffc25218 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:39.838399 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a9f6bbf3-baff-45af-9e45-e1c9ffc25218 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1314 microversion: 2.1 time: 0.146236 Jan 28 02:02:39.838959 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 447/902] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:39 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:39.933254 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f8e35fc8-0423-4310-8142-7495f7f30503 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:39.934033 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f8e35fc8-0423-4310-8142-7495f7f30503 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:39.940516 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f8e35fc8-0423-4310-8142-7495f7f30503 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:39.941075 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f8e35fc8-0423-4310-8142-7495f7f30503 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:39.941850 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f8e35fc8-0423-4310-8142-7495f7f30503 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:39.942284 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f8e35fc8-0423-4310-8142-7495f7f30503 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.071475 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f8e35fc8-0423-4310-8142-7495f7f30503 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:40.079853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f8e35fc8-0423-4310-8142-7495f7f30503 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1699 microversion: 2.1 time: 0.150604 Jan 28 02:02:40.080377 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 456/903] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:39 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:40.097122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e6218403-c4d9-487c-a641-b57fd5b1fd6d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:40.103095 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e6218403-c4d9-487c-a641-b57fd5b1fd6d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.103557 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e6218403-c4d9-487c-a641-b57fd5b1fd6d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.165739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e6218403-c4d9-487c-a641-b57fd5b1fd6d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Going to try to start instance {{(pid=115797) start /opt/stack/nova/nova/compute/api.py:2675}} Jan 28 02:02:40.208724 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e6218403-c4d9-487c-a641-b57fd5b1fd6d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 202 len: 0 microversion: 2.1 time: 0.115249 Jan 28 02:02:40.209344 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 448/904] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:40 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:40.218755 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-45bc33ad-f04e-40f3-b32e-d07a6eaa6b06 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:40.219363 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-45bc33ad-f04e-40f3-b32e-d07a6eaa6b06 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:40.225517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-45bc33ad-f04e-40f3-b32e-d07a6eaa6b06 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.226110 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-45bc33ad-f04e-40f3-b32e-d07a6eaa6b06 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.226891 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-45bc33ad-f04e-40f3-b32e-d07a6eaa6b06 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.227331 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-45bc33ad-f04e-40f3-b32e-d07a6eaa6b06 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.247717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0bc0a309-b3b9-4105-9a20-5b17f66779f6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:40.248731 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0bc0a309-b3b9-4105-9a20-5b17f66779f6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:40.256135 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0bc0a309-b3b9-4105-9a20-5b17f66779f6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.256589 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0bc0a309-b3b9-4105-9a20-5b17f66779f6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.257765 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0bc0a309-b3b9-4105-9a20-5b17f66779f6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.258217 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0bc0a309-b3b9-4105-9a20-5b17f66779f6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.357786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-45bc33ad-f04e-40f3-b32e-d07a6eaa6b06 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:40.365872 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-45bc33ad-f04e-40f3-b32e-d07a6eaa6b06 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1708 microversion: 2.1 time: 0.151451 Jan 28 02:02:40.366976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 457/905] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:40 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:40.368662 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0bc0a309-b3b9-4105-9a20-5b17f66779f6 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 38242 microversion: 2.20 time: 0.125537 Jan 28 02:02:40.370453 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 449/906] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:40 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 38242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:02:40.856560 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1c4b6411-5c5a-4510-8536-9cd8b4310cf2 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:40.857201 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1c4b6411-5c5a-4510-8536-9cd8b4310cf2 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:40.863316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c4b6411-5c5a-4510-8536-9cd8b4310cf2 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.863766 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c4b6411-5c5a-4510-8536-9cd8b4310cf2 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.864548 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c4b6411-5c5a-4510-8536-9cd8b4310cf2 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:40.865099 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c4b6411-5c5a-4510-8536-9cd8b4310cf2 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:40.999733 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c4b6411-5c5a-4510-8536-9cd8b4310cf2 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:41.007484 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1c4b6411-5c5a-4510-8536-9cd8b4310cf2 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1314 microversion: 2.1 time: 0.155941 Jan 28 02:02:41.008045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 458/907] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:40 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:41.029743 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-767c4177-4b19-49b6-ae30-9bb1e0b17488 req-cc578930-5bae-4225-ab3a-fe13d4c1e2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb5a503-0fc9-4510-a086-3273a19837e9", "name": "network-vif-plugged", "status": "completed", "tag": "3400fbc1-29c5-4e24-87ed-c5731f87a36a"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:41.031616 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:41.031616 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:02:41.039126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-767c4177-4b19-49b6-ae30-9bb1e0b17488 req-cc578930-5bae-4225-ab3a-fe13d4c1e2cb service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.039619 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-767c4177-4b19-49b6-ae30-9bb1e0b17488 req-cc578930-5bae-4225-ab3a-fe13d4c1e2cb service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.051467 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-767c4177-4b19-49b6-ae30-9bb1e0b17488 req-cc578930-5bae-4225-ab3a-fe13d4c1e2cb service nova] Creating event network-vif-plugged:3400fbc1-29c5-4e24-87ed-c5731f87a36a for instance 9cb5a503-0fc9-4510-a086-3273a19837e9 on hv-cinder-82497 Jan 28 02:02:41.057271 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-767c4177-4b19-49b6-ae30-9bb1e0b17488 req-cc578930-5bae-4225-ab3a-fe13d4c1e2cb service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158806 Jan 28 02:02:41.057999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 450/908] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:02:41.381421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9452f2a2-9539-4392-973b-0456d4c4f8e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:41.382372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9452f2a2-9539-4392-973b-0456d4c4f8e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:41.383792 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-700ad194-1b17-4e30-83c2-6a9a83eabd57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:41.384595 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-700ad194-1b17-4e30-83c2-6a9a83eabd57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:41.389009 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9452f2a2-9539-4392-973b-0456d4c4f8e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.389470 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9452f2a2-9539-4392-973b-0456d4c4f8e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.390253 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9452f2a2-9539-4392-973b-0456d4c4f8e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.390698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9452f2a2-9539-4392-973b-0456d4c4f8e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.391130 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-700ad194-1b17-4e30-83c2-6a9a83eabd57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.391578 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-700ad194-1b17-4e30-83c2-6a9a83eabd57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.392346 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-700ad194-1b17-4e30-83c2-6a9a83eabd57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.392780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-700ad194-1b17-4e30-83c2-6a9a83eabd57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.516829 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-700ad194-1b17-4e30-83c2-6a9a83eabd57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:41.524833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-700ad194-1b17-4e30-83c2-6a9a83eabd57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1708 microversion: 2.1 time: 0.145129 Jan 28 02:02:41.525520 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 451/909] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:41 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1708 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:41.782159 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9452f2a2-9539-4392-973b-0456d4c4f8e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 200 len: 38383 microversion: 2.20 time: 0.404153 Jan 28 02:02:41.782732 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 459/910] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:41 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 38383 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:41.793458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bf3229a0-4c62-4a7e-9f37-45781efab1d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:41.793964 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bf3229a0-4c62-4a7e-9f37-45781efab1d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:41.801550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf3229a0-4c62-4a7e-9f37-45781efab1d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.802271 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf3229a0-4c62-4a7e-9f37-45781efab1d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.803594 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf3229a0-4c62-4a7e-9f37-45781efab1d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.804295 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf3229a0-4c62-4a7e-9f37-45781efab1d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.809545 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-47c49946-12c2-426f-8bb0-c741193c4194 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:41.810766 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-47c49946-12c2-426f-8bb0-c741193c4194 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:41.817563 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47c49946-12c2-426f-8bb0-c741193c4194 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.818015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47c49946-12c2-426f-8bb0-c741193c4194 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.818801 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47c49946-12c2-426f-8bb0-c741193c4194 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.819237 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47c49946-12c2-426f-8bb0-c741193c4194 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.831865 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bf3229a0-4c62-4a7e-9f37-45781efab1d4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/ips" status: 200 len: 152 microversion: 2.20 time: 0.042670 Jan 28 02:02:41.832461 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 452/911] 10.222.0.96 () {60 vars in 1288 bytes} [Fri Jan 28 02:02:41 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:02:41.843522 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-47c49946-12c2-426f-8bb0-c741193c4194 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lazy-loading 'flavor' on Instance uuid a298e144-76c9-46a8-9fd3-10930cffe935 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:02:41.933200 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-47c49946-12c2-426f-8bb0-c741193c4194 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "POST /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935/action" status: 202 len: 0 microversion: 2.1 time: 0.131091 Jan 28 02:02:41.933782 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 460/912] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:02:41 2022] POST /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:02:41.942230 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1bb5d35d-21a9-4a34-8c9b-4d13cd190643 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:41.942985 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1bb5d35d-21a9-4a34-8c9b-4d13cd190643 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:41.950005 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1bb5d35d-21a9-4a34-8c9b-4d13cd190643 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.950671 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1bb5d35d-21a9-4a34-8c9b-4d13cd190643 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:41.951691 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1bb5d35d-21a9-4a34-8c9b-4d13cd190643 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:41.952436 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1bb5d35d-21a9-4a34-8c9b-4d13cd190643 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:42.024008 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1c8abd81-b179-43ea-97b4-8098f54b08c9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:42.024715 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1c8abd81-b179-43ea-97b4-8098f54b08c9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:42.031621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c8abd81-b179-43ea-97b4-8098f54b08c9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:42.032079 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c8abd81-b179-43ea-97b4-8098f54b08c9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:42.033024 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c8abd81-b179-43ea-97b4-8098f54b08c9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:42.033405 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c8abd81-b179-43ea-97b4-8098f54b08c9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:42.120293 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1bb5d35d-21a9-4a34-8c9b-4d13cd190643 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:42.130754 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1bb5d35d-21a9-4a34-8c9b-4d13cd190643 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.192575 Jan 28 02:02:42.140784 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 453/913] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:41 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:42.186540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c8abd81-b179-43ea-97b4-8098f54b08c9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:42.194092 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1c8abd81-b179-43ea-97b4-8098f54b08c9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1314 microversion: 2.1 time: 0.174067 Jan 28 02:02:42.194651 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 461/914] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:42 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:42.542563 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-57ef8962-6318-44d6-a8f6-f5a285d95b34 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:42.543201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-57ef8962-6318-44d6-a8f6-f5a285d95b34 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:42.550492 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57ef8962-6318-44d6-a8f6-f5a285d95b34 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:42.551091 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57ef8962-6318-44d6-a8f6-f5a285d95b34 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:42.552306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57ef8962-6318-44d6-a8f6-f5a285d95b34 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:42.552528 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57ef8962-6318-44d6-a8f6-f5a285d95b34 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:42.678234 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-57ef8962-6318-44d6-a8f6-f5a285d95b34 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:42.686869 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-57ef8962-6318-44d6-a8f6-f5a285d95b34 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1712 microversion: 2.1 time: 0.147971 Jan 28 02:02:42.687432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 454/915] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:42 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:43.147638 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-347c07a8-c0cd-4fa3-9cae-2685a1891805 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:43.148022 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-347c07a8-c0cd-4fa3-9cae-2685a1891805 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:43.154366 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-347c07a8-c0cd-4fa3-9cae-2685a1891805 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.154817 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-347c07a8-c0cd-4fa3-9cae-2685a1891805 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.155853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-347c07a8-c0cd-4fa3-9cae-2685a1891805 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.156293 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-347c07a8-c0cd-4fa3-9cae-2685a1891805 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.212339 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a6f66e13-1995-45ef-89bb-b21090dd4d8a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:43.213151 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a6f66e13-1995-45ef-89bb-b21090dd4d8a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:43.219192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6f66e13-1995-45ef-89bb-b21090dd4d8a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.219650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6f66e13-1995-45ef-89bb-b21090dd4d8a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.220434 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6f66e13-1995-45ef-89bb-b21090dd4d8a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:43.220972 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6f66e13-1995-45ef-89bb-b21090dd4d8a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:43.344270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-347c07a8-c0cd-4fa3-9cae-2685a1891805 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:43.351648 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-347c07a8-c0cd-4fa3-9cae-2685a1891805 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.208091 Jan 28 02:02:43.352228 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 462/916] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:43 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:43.454367 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a6f66e13-1995-45ef-89bb-b21090dd4d8a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:43.461925 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a6f66e13-1995-45ef-89bb-b21090dd4d8a tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1498 microversion: 2.1 time: 0.253183 Jan 28 02:02:43.463302 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 455/917] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:43 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1498 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:44.032034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b6eff9bb-91c8-4ebe-b934-8dc7e62578ce tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:44.032569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b6eff9bb-91c8-4ebe-b934-8dc7e62578ce tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:44.038416 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6eff9bb-91c8-4ebe-b934-8dc7e62578ce tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.038875 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6eff9bb-91c8-4ebe-b934-8dc7e62578ce tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.039672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6eff9bb-91c8-4ebe-b934-8dc7e62578ce tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.040114 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6eff9bb-91c8-4ebe-b934-8dc7e62578ce tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.078528 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-b6eff9bb-91c8-4ebe-b934-8dc7e62578ce tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lazy-loading 'flavor' on Instance uuid 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:02:44.131538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f255ec34-e5dc-40f0-b8d5-d7194dc5b3a9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:44.132049 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f255ec34-e5dc-40f0-b8d5-d7194dc5b3a9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:44.139559 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f255ec34-e5dc-40f0-b8d5-d7194dc5b3a9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.140016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f255ec34-e5dc-40f0-b8d5-d7194dc5b3a9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.140829 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f255ec34-e5dc-40f0-b8d5-d7194dc5b3a9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.141278 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f255ec34-e5dc-40f0-b8d5-d7194dc5b3a9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.169280 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f255ec34-e5dc-40f0-b8d5-d7194dc5b3a9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:02:44.257838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f255ec34-e5dc-40f0-b8d5-d7194dc5b3a9 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 204 len: 0 microversion: 2.1 time: 0.129783 Jan 28 02:02:44.258632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 456/918] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:02:44 2022] DELETE /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:02:44.267281 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5adbc5c3-fc73-4a57-91ed-40fb378d46b8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:44.267961 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5adbc5c3-fc73-4a57-91ed-40fb378d46b8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:44.273608 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5adbc5c3-fc73-4a57-91ed-40fb378d46b8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.274051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5adbc5c3-fc73-4a57-91ed-40fb378d46b8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.274832 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5adbc5c3-fc73-4a57-91ed-40fb378d46b8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.275427 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5adbc5c3-fc73-4a57-91ed-40fb378d46b8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.350941 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b6eff9bb-91c8-4ebe-b934-8dc7e62578ce tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 202 len: 0 microversion: 2.20 time: 0.322702 Jan 28 02:02:44.351547 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 463/919] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:02:44 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:02:44.360580 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:44.361400 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:44.370248 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.370794 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.371640 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.372080 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.411033 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5adbc5c3-fc73-4a57-91ed-40fb378d46b8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:44.420032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5adbc5c3-fc73-4a57-91ed-40fb378d46b8 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1504 microversion: 2.1 time: 0.156421 Jan 28 02:02:44.420603 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 457/920] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:44 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:44.425059 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6c011df0-34ec-4ada-862f-39b1c70cf9cf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:44.425661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6c011df0-34ec-4ada-862f-39b1c70cf9cf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:44.432067 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c011df0-34ec-4ada-862f-39b1c70cf9cf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.432514 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c011df0-34ec-4ada-862f-39b1c70cf9cf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.433744 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c011df0-34ec-4ada-862f-39b1c70cf9cf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:44.434394 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c011df0-34ec-4ada-862f-39b1c70cf9cf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:44.543759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:44.553168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:44.554675 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:44.555838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-76d6d306-0fa2-4fe8-843a-77b6a85c36ef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.199686 Jan 28 02:02:44.557072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 464/921] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:44 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:02:44.592926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6c011df0-34ec-4ada-862f-39b1c70cf9cf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:44.600710 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6c011df0-34ec-4ada-862f-39b1c70cf9cf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.179088 Jan 28 02:02:44.601311 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 458/922] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:44 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:45.437685 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3055257e-5a1b-4664-ac1b-7c0067a1e697 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:45.438370 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3055257e-5a1b-4664-ac1b-7c0067a1e697 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:45.444612 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3055257e-5a1b-4664-ac1b-7c0067a1e697 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.445163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3055257e-5a1b-4664-ac1b-7c0067a1e697 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.445936 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3055257e-5a1b-4664-ac1b-7c0067a1e697 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.446372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3055257e-5a1b-4664-ac1b-7c0067a1e697 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.571932 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3055257e-5a1b-4664-ac1b-7c0067a1e697 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:45.575152 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:45.575760 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:45.580352 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3055257e-5a1b-4664-ac1b-7c0067a1e697 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1504 microversion: 2.1 time: 0.146416 Jan 28 02:02:45.580970 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 465/923] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:45 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:45.581547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.581994 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.582786 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.583217 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.618217 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6058df3d-4298-45ba-9cc1-97703112e2e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:45.619362 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6058df3d-4298-45ba-9cc1-97703112e2e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:45.625296 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6058df3d-4298-45ba-9cc1-97703112e2e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.625748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6058df3d-4298-45ba-9cc1-97703112e2e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.626530 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6058df3d-4298-45ba-9cc1-97703112e2e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:45.626995 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6058df3d-4298-45ba-9cc1-97703112e2e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:45.735984 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:45.744713 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:45.746422 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:45.747599 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bcc16ceb-b870-4588-81c3-7d3ea3c08d5a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.176831 Jan 28 02:02:45.748152 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 459/924] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:45 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:02:45.783834 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6058df3d-4298-45ba-9cc1-97703112e2e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:45.791540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6058df3d-4298-45ba-9cc1-97703112e2e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.176910 Jan 28 02:02:45.792106 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 466/925] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:45 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:46.598611 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4d53d591-7948-458c-9623-bbcf270807b4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:46.599552 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4d53d591-7948-458c-9623-bbcf270807b4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:46.606720 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4d53d591-7948-458c-9623-bbcf270807b4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.607164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4d53d591-7948-458c-9623-bbcf270807b4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.607941 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4d53d591-7948-458c-9623-bbcf270807b4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.608369 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4d53d591-7948-458c-9623-bbcf270807b4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.764418 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4d53d591-7948-458c-9623-bbcf270807b4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:46.767288 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:46.767868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:46.773317 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4d53d591-7948-458c-9623-bbcf270807b4 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1504 microversion: 2.1 time: 0.179050 Jan 28 02:02:46.773619 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.773906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 460/926] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:46 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:46.774099 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.774926 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.775476 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.807590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5a28dbe9-9919-4580-8ffa-79baa8c822ad tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:46.808207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5a28dbe9-9919-4580-8ffa-79baa8c822ad tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:46.814155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a28dbe9-9919-4580-8ffa-79baa8c822ad tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.814605 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a28dbe9-9919-4580-8ffa-79baa8c822ad tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:46.815381 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a28dbe9-9919-4580-8ffa-79baa8c822ad tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:46.815817 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a28dbe9-9919-4580-8ffa-79baa8c822ad tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.042708 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:47.050411 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:47.051988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:47.053252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a97443ee-8db5-4425-b380-f3f3fbc0fa0a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.289797 Jan 28 02:02:47.053820 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 467/927] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:46 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:47.068430 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5a28dbe9-9919-4580-8ffa-79baa8c822ad tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:47.076472 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5a28dbe9-9919-4580-8ffa-79baa8c822ad tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.272866 Jan 28 02:02:47.077097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 461/928] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:46 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:47.332658 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-a33df611-56f5-46bd-aa64-09b64bd49445 req-2b08337e-0966-4411-b089-9f829a382cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb5a503-0fc9-4510-a086-3273a19837e9", "name": "network-vif-deleted", "tag": "3400fbc1-29c5-4e24-87ed-c5731f87a36a"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:02:47.334357 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:47.334357 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:02:47.341960 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-a33df611-56f5-46bd-aa64-09b64bd49445 req-2b08337e-0966-4411-b089-9f829a382cfe service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.342409 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-a33df611-56f5-46bd-aa64-09b64bd49445 req-2b08337e-0966-4411-b089-9f829a382cfe service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.353708 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-a33df611-56f5-46bd-aa64-09b64bd49445 req-2b08337e-0966-4411-b089-9f829a382cfe service nova] Creating event network-vif-deleted:3400fbc1-29c5-4e24-87ed-c5731f87a36a for instance 9cb5a503-0fc9-4510-a086-3273a19837e9 on hv-cinder-82497 Jan 28 02:02:47.358973 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-a33df611-56f5-46bd-aa64-09b64bd49445 req-2b08337e-0966-4411-b089-9f829a382cfe service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029915 Jan 28 02:02:47.359616 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 468/929] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:02:47.796343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:47.796995 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:47.802835 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.803290 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.804065 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.804506 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.834808 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:47.835262 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:47.835719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lazy-loading 'fault' on Instance uuid 9cb5a503-0fc9-4510-a086-3273a19837e9 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:02:47.875318 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63df08c6076844ab853626d2cf658dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:47.882741 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3f916298-e970-4553-b60f-f8a1194a6576 tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 200 len: 1304 microversion: 2.1 time: 0.090012 Jan 28 02:02:47.883311 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 462/930] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:47 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:48.072773 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:48.073570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:48.079688 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.080146 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.080963 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.081421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.093856 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4e466a90-2867-43a1-bb6a-ae393e8b1f43 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:48.094466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4e466a90-2867-43a1-bb6a-ae393e8b1f43 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:48.100305 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e466a90-2867-43a1-bb6a-ae393e8b1f43 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.100748 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e466a90-2867-43a1-bb6a-ae393e8b1f43 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.101678 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e466a90-2867-43a1-bb6a-ae393e8b1f43 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.102064 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e466a90-2867-43a1-bb6a-ae393e8b1f43 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.263018 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:48.270937 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4e466a90-2867-43a1-bb6a-ae393e8b1f43 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:48.271551 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:48.273105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:48.274325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e6f77d05-c4e7-47e6-8fdc-f22be1225b06 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.206543 Jan 28 02:02:48.275768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 469/931] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:48 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:48.279874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4e466a90-2867-43a1-bb6a-ae393e8b1f43 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.189521 Jan 28 02:02:48.280784 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 463/932] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:48 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:48.900296 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:48.901131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] [instance: 9cb5a503-0fc9-4510-a086-3273a19837e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:48.907243 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.907695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.908479 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:48.908926 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:48.922303 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] HTTP exception thrown: Instance 9cb5a503-0fc9-4510-a086-3273a19837e9 could not be found. Jan 28 02:02:48.922924 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] Returning 404 to user: Instance 9cb5a503-0fc9-4510-a086-3273a19837e9 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:02:48.923756 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-08503b0b-e895-413e-b085-2d59a138cd7b tempest-VolumesActionsTest-90352464 tempest-VolumesActionsTest-90352464-project] 10.222.0.96 "GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9" status: 404 len: 111 microversion: 2.1 time: 0.027327 Jan 28 02:02:48.924291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 470/933] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:48 2022] GET /compute/v2.1/servers/9cb5a503-0fc9-4510-a086-3273a19837e9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:02:49.294282 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:49.296542 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:49.297927 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bec9c7d7-8f61-49b8-9197-054a6942b8c5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:49.298684 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bec9c7d7-8f61-49b8-9197-054a6942b8c5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:49.301871 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:49.302186 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:49.302958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:49.303392 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:49.306102 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bec9c7d7-8f61-49b8-9197-054a6942b8c5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:49.306102 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bec9c7d7-8f61-49b8-9197-054a6942b8c5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:49.307364 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bec9c7d7-8f61-49b8-9197-054a6942b8c5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:49.307977 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bec9c7d7-8f61-49b8-9197-054a6942b8c5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:49.498490 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bec9c7d7-8f61-49b8-9197-054a6942b8c5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:49.502541 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:49.510665 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:49.512473 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:49.513366 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bec9c7d7-8f61-49b8-9197-054a6942b8c5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.218977 Jan 28 02:02:49.514084 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dd441a39-7975-4199-96ba-cab32bc34019 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.223825 Jan 28 02:02:49.523113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 471/934] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:49 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:02:49.523288 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 464/935] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:49 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:50.529898 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-47d83a7e-5308-4a65-b28e-e07790ffd77b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:50.530525 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-47d83a7e-5308-4a65-b28e-e07790ffd77b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:50.531635 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:50.532243 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:50.537513 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47d83a7e-5308-4a65-b28e-e07790ffd77b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:50.538052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47d83a7e-5308-4a65-b28e-e07790ffd77b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:50.538239 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:50.538808 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:50.538940 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47d83a7e-5308-4a65-b28e-e07790ffd77b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:50.539281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47d83a7e-5308-4a65-b28e-e07790ffd77b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:50.539462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:50.539895 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:50.722288 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-47d83a7e-5308-4a65-b28e-e07790ffd77b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:50.727222 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:50.730796 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-47d83a7e-5308-4a65-b28e-e07790ffd77b tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.204975 Jan 28 02:02:50.731352 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 472/936] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:50 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:50.735673 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:50.737680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:50.739222 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c33a5f6d-183e-41d0-81d9-adc5cdec8017 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.211479 Jan 28 02:02:50.739922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 465/937] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:50 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:02:51.747776 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2c6ffc4e-81e9-400a-abb4-a7617146b4a9 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:51.748386 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2c6ffc4e-81e9-400a-abb4-a7617146b4a9 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:51.754381 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c6ffc4e-81e9-400a-abb4-a7617146b4a9 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.754837 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c6ffc4e-81e9-400a-abb4-a7617146b4a9 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.755628 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c6ffc4e-81e9-400a-abb4-a7617146b4a9 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.756068 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c6ffc4e-81e9-400a-abb4-a7617146b4a9 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.758371 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:51.758984 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:51.765212 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.765670 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.766458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:51.766896 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:51.940733 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2c6ffc4e-81e9-400a-abb4-a7617146b4a9 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:51.945715 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:51.948846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2c6ffc4e-81e9-400a-abb4-a7617146b4a9 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.205262 Jan 28 02:02:51.949433 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 473/938] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:51 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:51.954428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:51.956034 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:51.957226 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7441bfc9-a880-428c-80a5-1b264ede059e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.202490 Jan 28 02:02:51.957777 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 466/939] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:51 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:02:52.965605 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a6505c2b-ffff-434d-98f0-199e0e594bf7 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:52.966158 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a6505c2b-ffff-434d-98f0-199e0e594bf7 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:52.972124 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a6505c2b-ffff-434d-98f0-199e0e594bf7 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:52.972570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a6505c2b-ffff-434d-98f0-199e0e594bf7 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:52.973539 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a6505c2b-ffff-434d-98f0-199e0e594bf7 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:52.973811 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a6505c2b-ffff-434d-98f0-199e0e594bf7 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:52.975287 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:52.975893 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:52.982193 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:52.982642 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:52.983417 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:52.983853 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:53.152828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a6505c2b-ffff-434d-98f0-199e0e594bf7 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:53.157734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:53.160694 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a6505c2b-ffff-434d-98f0-199e0e594bf7 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.199523 Jan 28 02:02:53.161296 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 474/940] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:52 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:53.165627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:53.167598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:53.168772 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-78fc69f9-0bff-443e-8e76-352f715696e7 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.197219 Jan 28 02:02:53.169350 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 467/941] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:52 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:02:54.178602 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da359ce8-4498-465e-ad8b-5569c39a95e8 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:54.179944 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-da359ce8-4498-465e-ad8b-5569c39a95e8 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:54.187727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da359ce8-4498-465e-ad8b-5569c39a95e8 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:54.188425 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:54.189062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da359ce8-4498-465e-ad8b-5569c39a95e8 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:54.189251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:54.189707 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da359ce8-4498-465e-ad8b-5569c39a95e8 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:54.190230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da359ce8-4498-465e-ad8b-5569c39a95e8 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:54.197780 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:54.198584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:54.199823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:54.200488 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:54.366367 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-da359ce8-4498-465e-ad8b-5569c39a95e8 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:54.375102 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-da359ce8-4498-465e-ad8b-5569c39a95e8 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.200277 Jan 28 02:02:54.375688 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 475/942] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:54 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:54.423108 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:54.432668 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:54.434860 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:54.436185 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8c7ff7b6-1dc1-4592-8299-9619e19a6f11 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.252312 Jan 28 02:02:54.436886 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 468/943] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:54 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:55.392860 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6a8e9bbc-442f-4060-b240-52ce627fc8e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:55.394191 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6a8e9bbc-442f-4060-b240-52ce627fc8e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:55.401781 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6a8e9bbc-442f-4060-b240-52ce627fc8e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:55.402560 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6a8e9bbc-442f-4060-b240-52ce627fc8e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.403581 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6a8e9bbc-442f-4060-b240-52ce627fc8e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:55.404238 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6a8e9bbc-442f-4060-b240-52ce627fc8e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.455652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:55.456263 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:55.464569 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:55.465355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.466337 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:55.467243 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:55.591540 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6a8e9bbc-442f-4060-b240-52ce627fc8e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:55.602996 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6a8e9bbc-442f-4060-b240-52ce627fc8e6 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.213751 Jan 28 02:02:55.604529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 476/944] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:55 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:55.656665 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:55.665535 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:55.667550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:55.668738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b67baec2-1c85-4b49-b00d-e755361bcb72 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.217078 Jan 28 02:02:55.669333 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 469/945] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:55 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:56.622176 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1b049d3f-6dba-4f60-b690-19e28a37480e tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:56.623424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1b049d3f-6dba-4f60-b690-19e28a37480e tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:56.629646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b049d3f-6dba-4f60-b690-19e28a37480e tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.630405 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b049d3f-6dba-4f60-b690-19e28a37480e tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.631379 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b049d3f-6dba-4f60-b690-19e28a37480e tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.632013 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b049d3f-6dba-4f60-b690-19e28a37480e tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.686680 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:56.687395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:56.696265 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.696265 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.696615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:56.697550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:56.812902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1b049d3f-6dba-4f60-b690-19e28a37480e tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:56.826509 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1b049d3f-6dba-4f60-b690-19e28a37480e tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.207708 Jan 28 02:02:56.827569 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 477/946] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:56 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:56.885231 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:56.893749 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:56.895229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:56.896396 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-93561ec5-4d84-437f-bead-a8a94403ce75 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.213363 Jan 28 02:02:56.896971 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 470/947] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:56 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:02:57.845502 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4273dc66-d000-4892-947e-98c03c53d2d5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:57.847222 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4273dc66-d000-4892-947e-98c03c53d2d5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:57.855019 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4273dc66-d000-4892-947e-98c03c53d2d5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.855872 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4273dc66-d000-4892-947e-98c03c53d2d5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.856918 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4273dc66-d000-4892-947e-98c03c53d2d5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.857567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4273dc66-d000-4892-947e-98c03c53d2d5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.915213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:57.916654 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:57.923621 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.924440 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:57.925515 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:57.926166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:58.520748 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4273dc66-d000-4892-947e-98c03c53d2d5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:58.536772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4273dc66-d000-4892-947e-98c03c53d2d5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.687273 Jan 28 02:02:58.538326 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 478/948] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:57 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:58.568181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:58.577869 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:58.579712 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:58.581193 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7b4e4088-21e4-4be1-8804-3cd5e550b738 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.669654 Jan 28 02:02:58.592421 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 471/949] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:57 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:02:59.555876 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f08f2407-af06-4d9d-ad76-3fac09ad8dd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:59.557384 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f08f2407-af06-4d9d-ad76-3fac09ad8dd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:59.563599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f08f2407-af06-4d9d-ad76-3fac09ad8dd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:59.564126 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f08f2407-af06-4d9d-ad76-3fac09ad8dd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:59.565030 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f08f2407-af06-4d9d-ad76-3fac09ad8dd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:59.565542 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f08f2407-af06-4d9d-ad76-3fac09ad8dd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:59.600652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:59.601449 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:02:59.608978 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:59.609430 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:59.610598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:02:59.610712 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:02:59.779874 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f08f2407-af06-4d9d-ad76-3fac09ad8dd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:59.788871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f08f2407-af06-4d9d-ad76-3fac09ad8dd2 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.237221 Jan 28 02:02:59.789933 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 479/950] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:02:59 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:59.814054 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:59.824654 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:59.826581 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:02:59.827992 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-126c8a07-ec19-4769-9061-cc8b9e6e8b8f tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.231813 Jan 28 02:02:59.828732 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 472/951] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:02:59 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:03:00.807065 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-073db1fe-f690-4059-80e8-318fb9621345 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:00.807635 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-073db1fe-f690-4059-80e8-318fb9621345 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:00.816533 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-073db1fe-f690-4059-80e8-318fb9621345 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.817488 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-073db1fe-f690-4059-80e8-318fb9621345 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.818681 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-073db1fe-f690-4059-80e8-318fb9621345 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.819508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-073db1fe-f690-4059-80e8-318fb9621345 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.850133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:00.851522 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:00.863361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.864184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:00.868086 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:00.868897 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:01.097760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-073db1fe-f690-4059-80e8-318fb9621345 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:01.107390 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:01.108196 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-073db1fe-f690-4059-80e8-318fb9621345 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.304778 Jan 28 02:03:01.109459 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 480/952] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:00 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:01.125872 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:01.126409 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:01.127609 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-05d91041-b995-469a-8129-f83bfd31797b tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1745 microversion: 2.20 time: 0.281456 Jan 28 02:03:01.139509 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 473/953] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:00 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1745 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:03:02.130249 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-63cdcc4f-9a7d-4f19-95ff-8f6dc7c8654f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:02.132251 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-63cdcc4f-9a7d-4f19-95ff-8f6dc7c8654f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.149207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:02.151425 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.152631 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63cdcc4f-9a7d-4f19-95ff-8f6dc7c8654f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.154026 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63cdcc4f-9a7d-4f19-95ff-8f6dc7c8654f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.156187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63cdcc4f-9a7d-4f19-95ff-8f6dc7c8654f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.157877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63cdcc4f-9a7d-4f19-95ff-8f6dc7c8654f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.165363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.166586 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.167534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.167973 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.383620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-63cdcc4f-9a7d-4f19-95ff-8f6dc7c8654f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:02.392342 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-63cdcc4f-9a7d-4f19-95ff-8f6dc7c8654f tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1507 microversion: 2.1 time: 0.270333 Jan 28 02:03:02.400446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:02.401858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 481/954] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:02 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:02.412151 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8cf048b4-8773-4335-8fd2-0a0cfa657aa5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:02.413701 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:02.416387 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8cf048b4-8773-4335-8fd2-0a0cfa657aa5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.417405 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:02.419270 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f4e0440d-97e6-4635-8e40-a4d8339cee41 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1745 microversion: 2.20 time: 0.276100 Jan 28 02:03:02.431925 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 474/955] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:02 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1745 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:02.438535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8cf048b4-8773-4335-8fd2-0a0cfa657aa5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.450077 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8cf048b4-8773-4335-8fd2-0a0cfa657aa5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.450988 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8cf048b4-8773-4335-8fd2-0a0cfa657aa5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.451439 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8cf048b4-8773-4335-8fd2-0a0cfa657aa5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.561992 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8cf048b4-8773-4335-8fd2-0a0cfa657aa5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "POST /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935/action" status: 202 len: 0 microversion: 2.1 time: 0.151024 Jan 28 02:03:02.563624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 482/956] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:03:02 2022] POST /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:03:02.573127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-66a39028-a6ff-4b66-af3f-dc1bd292c67c tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:02.574620 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-66a39028-a6ff-4b66-af3f-dc1bd292c67c tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:02.588995 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66a39028-a6ff-4b66-af3f-dc1bd292c67c tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.589549 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66a39028-a6ff-4b66-af3f-dc1bd292c67c tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.591424 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66a39028-a6ff-4b66-af3f-dc1bd292c67c tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:02.595688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66a39028-a6ff-4b66-af3f-dc1bd292c67c tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:02.754945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-66a39028-a6ff-4b66-af3f-dc1bd292c67c tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:02.765397 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-66a39028-a6ff-4b66-af3f-dc1bd292c67c tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1515 microversion: 2.1 time: 0.197218 Jan 28 02:03:02.766688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 475/957] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:02 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:03.079960 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-c058e612-a15b-4003-b922-dda040741c24 req-8bd206e0-6a4e-427f-8628-da0086a2efb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e2f5bb-ea79-4637-b7a5-5f4d10aebe58", "name": "network-vif-plugged", "status": "completed", "tag": "b3df727d-fb39-47e3-88bf-cdef71b67bf5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:03.081666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:03.081666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:03:03.098046 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-c058e612-a15b-4003-b922-dda040741c24 req-8bd206e0-6a4e-427f-8628-da0086a2efb2 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.100358 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-c058e612-a15b-4003-b922-dda040741c24 req-8bd206e0-6a4e-427f-8628-da0086a2efb2 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.130845 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-c058e612-a15b-4003-b922-dda040741c24 req-8bd206e0-6a4e-427f-8628-da0086a2efb2 service nova] Creating event network-vif-plugged:b3df727d-fb39-47e3-88bf-cdef71b67bf5 for instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 on hv-cinder-82497 Jan 28 02:03:03.137343 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-c058e612-a15b-4003-b922-dda040741c24 req-8bd206e0-6a4e-427f-8628-da0086a2efb2 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062145 Jan 28 02:03:03.140976 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 483/958] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:03:03.445178 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:03.445958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:03.465637 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.466508 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.467661 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.468770 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.785809 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e58ab824-cc61-4506-affa-ff85762fe3e5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:03.786812 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e58ab824-cc61-4506-affa-ff85762fe3e5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:03.787943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:03.798666 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e58ab824-cc61-4506-affa-ff85762fe3e5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.800337 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e58ab824-cc61-4506-affa-ff85762fe3e5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.802543 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:03.803208 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e58ab824-cc61-4506-affa-ff85762fe3e5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:03.804238 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:03.804937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e58ab824-cc61-4506-affa-ff85762fe3e5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:03.805503 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0a6ae579-f9cb-4f2f-a99c-cb672bec7f23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1740 microversion: 2.20 time: 0.364566 Jan 28 02:03:03.825259 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 476/959] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:03 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1740 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:04.028743 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e58ab824-cc61-4506-affa-ff85762fe3e5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:04.037615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e58ab824-cc61-4506-affa-ff85762fe3e5 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1517 microversion: 2.1 time: 0.257544 Jan 28 02:03:04.038298 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 484/960] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:03 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:04.830273 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:04.831499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:04.844623 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.846138 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:04.853758 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:04.854984 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.051127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:05.060920 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c3d2b568-c3a5-475e-b0b6-f4cafd3a212d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:05.061843 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c3d2b568-c3a5-475e-b0b6-f4cafd3a212d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:05.080097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:05.080374 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3d2b568-c3a5-475e-b0b6-f4cafd3a212d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.081762 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:05.083224 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8fbec6c6-b0fc-49b8-8515-44e92a1ae6f5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1740 microversion: 2.20 time: 0.261306 Jan 28 02:03:05.093512 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 477/961] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:04 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:03:05.093805 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3d2b568-c3a5-475e-b0b6-f4cafd3a212d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.093805 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3d2b568-c3a5-475e-b0b6-f4cafd3a212d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.093805 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3d2b568-c3a5-475e-b0b6-f4cafd3a212d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.166718 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-02c0df82-4db6-4320-9b5e-6158104658de req-e141555a-bdff-49b3-ad73-863ff712a9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a298e144-76c9-46a8-9fd3-10930cffe935", "name": "network-vif-unplugged", "status": "completed", "tag": "1938f369-8c3b-46ca-90e4-040b0e1f5517"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:05.179059 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:05.179059 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:03:05.206567 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-02c0df82-4db6-4320-9b5e-6158104658de req-e141555a-bdff-49b3-ad73-863ff712a9f2 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:05.207020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-02c0df82-4db6-4320-9b5e-6158104658de req-e141555a-bdff-49b3-ad73-863ff712a9f2 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:05.233458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-02c0df82-4db6-4320-9b5e-6158104658de req-e141555a-bdff-49b3-ad73-863ff712a9f2 service nova] Creating event network-vif-unplugged:1938f369-8c3b-46ca-90e4-040b0e1f5517 for instance a298e144-76c9-46a8-9fd3-10930cffe935 on hv-cinder-82497 Jan 28 02:03:05.250323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-02c0df82-4db6-4320-9b5e-6158104658de req-e141555a-bdff-49b3-ad73-863ff712a9f2 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087136 Jan 28 02:03:05.251219 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 478/962] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:05.388460 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c3d2b568-c3a5-475e-b0b6-f4cafd3a212d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:05.403472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c3d2b568-c3a5-475e-b0b6-f4cafd3a212d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.342428 Jan 28 02:03:05.404667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 485/963] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:05 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:06.120986 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:06.121739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:06.135090 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:06.135536 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:06.136314 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:06.136741 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:06.423682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8030b813-75ee-4ce1-86d8-cd4ac867dbde tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:06.425316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8030b813-75ee-4ce1-86d8-cd4ac867dbde tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:06.434408 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8030b813-75ee-4ce1-86d8-cd4ac867dbde tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:06.435294 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8030b813-75ee-4ce1-86d8-cd4ac867dbde tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:06.436665 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8030b813-75ee-4ce1-86d8-cd4ac867dbde tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:06.437589 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8030b813-75ee-4ce1-86d8-cd4ac867dbde tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:06.612614 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:06.642847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:06.644522 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:06.645777 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6976d4fd-27b2-4d25-90bd-43f3a72b90d5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1740 microversion: 2.20 time: 0.529920 Jan 28 02:03:06.646668 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 479/964] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:06 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1740 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:06.722344 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8030b813-75ee-4ce1-86d8-cd4ac867dbde tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:06.731550 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8030b813-75ee-4ce1-86d8-cd4ac867dbde tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.311822 Jan 28 02:03:06.734524 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 486/965] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:06 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:07.668447 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:07.669894 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:07.680036 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.680763 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.682097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.682714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.752710 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c3ecd8f1-52a5-4552-8d2d-ce76f0fbc884 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:07.753968 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c3ecd8f1-52a5-4552-8d2d-ce76f0fbc884 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:07.773218 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3ecd8f1-52a5-4552-8d2d-ce76f0fbc884 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.774086 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3ecd8f1-52a5-4552-8d2d-ce76f0fbc884 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.776139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3ecd8f1-52a5-4552-8d2d-ce76f0fbc884 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:07.777112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3ecd8f1-52a5-4552-8d2d-ce76f0fbc884 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:07.872418 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:07.881155 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:07.882650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:07.883836 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-036d89cf-c93c-401a-ba68-0c450c055549 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1740 microversion: 2.20 time: 0.221941 Jan 28 02:03:07.896759 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 480/966] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:07 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:07.967981 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c3ecd8f1-52a5-4552-8d2d-ce76f0fbc884 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:07.983708 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c3ecd8f1-52a5-4552-8d2d-ce76f0fbc884 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.235922 Jan 28 02:03:07.985532 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 487/967] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:07 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:08.905275 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:08.907148 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:08.921761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.923810 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:08.925553 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:08.927033 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:09.004139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a15df0dd-6242-4f23-99d1-fbe52b2b81f0 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:09.005559 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a15df0dd-6242-4f23-99d1-fbe52b2b81f0 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:09.016391 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a15df0dd-6242-4f23-99d1-fbe52b2b81f0 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:09.021065 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a15df0dd-6242-4f23-99d1-fbe52b2b81f0 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:09.022668 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a15df0dd-6242-4f23-99d1-fbe52b2b81f0 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:09.023325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a15df0dd-6242-4f23-99d1-fbe52b2b81f0 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:09.367340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a15df0dd-6242-4f23-99d1-fbe52b2b81f0 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:09.375925 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a15df0dd-6242-4f23-99d1-fbe52b2b81f0 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.376949 Jan 28 02:03:09.386810 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 488/968] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:08 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:09.391843 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:09.406627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:09.410456 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:09.412103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9ce6b849-3dcd-4ab7-a57f-028350360874 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1740 microversion: 2.20 time: 0.511380 Jan 28 02:03:09.425734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 481/969] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:08 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1740 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:10.405798 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-746e6e26-6933-4bce-a04d-ececc876a482 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:10.408170 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-746e6e26-6933-4bce-a04d-ececc876a482 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:10.414906 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-746e6e26-6933-4bce-a04d-ececc876a482 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:10.416281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-746e6e26-6933-4bce-a04d-ececc876a482 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:10.417400 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-746e6e26-6933-4bce-a04d-ececc876a482 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:10.418066 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-746e6e26-6933-4bce-a04d-ececc876a482 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:10.434431 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:10.435114 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:10.443782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:10.445052 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:10.446600 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:10.448451 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:10.635557 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:10.639418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-746e6e26-6933-4bce-a04d-ececc876a482 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:10.643555 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:10.646765 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-746e6e26-6933-4bce-a04d-ececc876a482 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.245326 Jan 28 02:03:10.648091 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:10.652046 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-61474705-a9bc-46ff-bd54-2c38a161beb4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1740 microversion: 2.20 time: 0.222065 Jan 28 02:03:10.652602 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 482/970] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:10 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:10.661771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 489/971] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:10 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:11.665924 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-be8cfd52-a296-404f-9759-1c1c9edaafb1 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:11.667282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-be8cfd52-a296-404f-9759-1c1c9edaafb1 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:11.670627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:11.671237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:11.674280 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be8cfd52-a296-404f-9759-1c1c9edaafb1 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:11.675163 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be8cfd52-a296-404f-9759-1c1c9edaafb1 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:11.676116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be8cfd52-a296-404f-9759-1c1c9edaafb1 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:11.676714 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be8cfd52-a296-404f-9759-1c1c9edaafb1 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:11.677795 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:11.678278 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:11.679128 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:11.679618 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:11.866500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-be8cfd52-a296-404f-9759-1c1c9edaafb1 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:11.874901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-be8cfd52-a296-404f-9759-1c1c9edaafb1 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.213295 Jan 28 02:03:11.890536 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 490/972] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:11 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:11.942236 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:11.952169 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:11.953870 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:11.955240 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f5d0acb5-4b18-4807-a7de-c5378c19bdcd tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1740 microversion: 2.20 time: 0.288257 Jan 28 02:03:11.966766 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 483/973] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:11 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:03:12.897288 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b493f7f4-ea1c-4f92-9e70-f0b904d92a3d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:12.897920 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b493f7f4-ea1c-4f92-9e70-f0b904d92a3d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:12.907066 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b493f7f4-ea1c-4f92-9e70-f0b904d92a3d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:12.907559 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b493f7f4-ea1c-4f92-9e70-f0b904d92a3d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:12.908360 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b493f7f4-ea1c-4f92-9e70-f0b904d92a3d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:12.909190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b493f7f4-ea1c-4f92-9e70-f0b904d92a3d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:12.976331 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:12.977738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:12.985833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:12.986686 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:12.987652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:12.988252 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:13.121667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b493f7f4-ea1c-4f92-9e70-f0b904d92a3d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:13.130147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b493f7f4-ea1c-4f92-9e70-f0b904d92a3d tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.236818 Jan 28 02:03:13.146555 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 491/974] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:12 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:13.183201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:13.197531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:13.200403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:13.202643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ad561795-429a-4dce-92c9-26bcee19a961 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1740 microversion: 2.20 time: 0.230916 Jan 28 02:03:13.203615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 484/975] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:12 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:14.154896 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9f2ea2c3-7d39-4a44-a4bd-151fd409f549 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:14.155588 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9f2ea2c3-7d39-4a44-a4bd-151fd409f549 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:14.162264 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f2ea2c3-7d39-4a44-a4bd-151fd409f549 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:14.162713 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f2ea2c3-7d39-4a44-a4bd-151fd409f549 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:14.163494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f2ea2c3-7d39-4a44-a4bd-151fd409f549 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:14.163925 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f2ea2c3-7d39-4a44-a4bd-151fd409f549 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:14.227499 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:14.228363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:14.235010 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:14.235708 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:14.236498 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:14.237156 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:14.430455 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9f2ea2c3-7d39-4a44-a4bd-151fd409f549 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:14.439384 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9f2ea2c3-7d39-4a44-a4bd-151fd409f549 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.288085 Jan 28 02:03:14.440373 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 492/976] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:14 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:14.485076 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:14.493383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:14.498807 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:14.500050 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ce304a5a-01c5-494a-829d-e69b66d79bef tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1722 microversion: 2.20 time: 0.276295 Jan 28 02:03:14.500858 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 485/977] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:14 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:03:15.457871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-085ac76e-1e21-4bda-a679-837a4d10b371 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:15.458478 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-085ac76e-1e21-4bda-a679-837a4d10b371 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:15.464653 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-085ac76e-1e21-4bda-a679-837a4d10b371 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:15.465111 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-085ac76e-1e21-4bda-a679-837a4d10b371 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:15.465882 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-085ac76e-1e21-4bda-a679-837a4d10b371 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:15.466316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-085ac76e-1e21-4bda-a679-837a4d10b371 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:15.519741 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:15.520685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:15.530945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:15.532547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:15.533643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:15.534393 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:15.610725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-085ac76e-1e21-4bda-a679-837a4d10b371 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:15.626115 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-085ac76e-1e21-4bda-a679-837a4d10b371 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.169843 Jan 28 02:03:15.626759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 493/978] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:15 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:15.760886 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:15.769718 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:15.772085 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:15.774051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3428d5f6-2a07-4bcc-aeb9-9f7d6e4cde74 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1722 microversion: 2.20 time: 0.258429 Jan 28 02:03:15.785551 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 486/979] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:15 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:16.645483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-50901b7c-0df5-4731-8c34-e52e68a0d487 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:16.647811 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-50901b7c-0df5-4731-8c34-e52e68a0d487 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:16.658832 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50901b7c-0df5-4731-8c34-e52e68a0d487 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:16.659961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50901b7c-0df5-4731-8c34-e52e68a0d487 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.661043 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50901b7c-0df5-4731-8c34-e52e68a0d487 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:16.661580 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50901b7c-0df5-4731-8c34-e52e68a0d487 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.794227 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:16.794989 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:16.801376 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:16.802128 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.803117 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:16.803649 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:16.945137 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-50901b7c-0df5-4731-8c34-e52e68a0d487 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:16.955216 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-50901b7c-0df5-4731-8c34-e52e68a0d487 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.315623 Jan 28 02:03:16.965324 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 494/980] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:16 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:17.055756 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:17.066922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:17.068637 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:17.070983 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-807094e5-0c3b-4268-83f6-c907135fdd8c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1725 microversion: 2.20 time: 0.281761 Jan 28 02:03:17.071810 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 487/981] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:16 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:17.094785 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0ab1f097-eac5-4c46-8982-a5d07a36be3a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2909f4e-c9c1-4136-bbdf-8086bc4f3910"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:17.099720 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0ab1f097-eac5-4c46-8982-a5d07a36be3a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:17.113459 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab1f097-eac5-4c46-8982-a5d07a36be3a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.121559 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab1f097-eac5-4c46-8982-a5d07a36be3a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.123820 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab1f097-eac5-4c46-8982-a5d07a36be3a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.125010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab1f097-eac5-4c46-8982-a5d07a36be3a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.156448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-0ea97c87-a6eb-45e9-8712-3257f1e4a79b req-155e340c-f5b5-4942-9b84-30d946fc93a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a298e144-76c9-46a8-9fd3-10930cffe935", "name": "network-vif-plugged", "status": "completed", "tag": "1938f369-8c3b-46ca-90e4-040b0e1f5517"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:17.172448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:17.172448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:03:17.197382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-0ea97c87-a6eb-45e9-8712-3257f1e4a79b req-155e340c-f5b5-4942-9b84-30d946fc93a8 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.198016 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-0ea97c87-a6eb-45e9-8712-3257f1e4a79b req-155e340c-f5b5-4942-9b84-30d946fc93a8 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.216189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-0ea97c87-a6eb-45e9-8712-3257f1e4a79b req-155e340c-f5b5-4942-9b84-30d946fc93a8 service nova] Creating event network-vif-plugged:1938f369-8c3b-46ca-90e4-040b0e1f5517 for instance a298e144-76c9-46a8-9fd3-10930cffe935 on hv-cinder-82497 Jan 28 02:03:17.228678 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-0ea97c87-a6eb-45e9-8712-3257f1e4a79b req-155e340c-f5b5-4942-9b84-30d946fc93a8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081625 Jan 28 02:03:17.229325 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 488/982] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:17.619902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0ab1f097-eac5-4c46-8982-a5d07a36be3a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.532656 Jan 28 02:03:17.620593 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 495/983] 10.222.0.96 () {62 vars in 1363 bytes} [Fri Jan 28 02:03:17 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/os-volume_attachments => generated 188 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:03:17.766119 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5e2b8ea3-aafa-4633-8fe0-97da24cd958e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:17.766861 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5e2b8ea3-aafa-4633-8fe0-97da24cd958e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:17.773902 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e2b8ea3-aafa-4633-8fe0-97da24cd958e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.774355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e2b8ea3-aafa-4633-8fe0-97da24cd958e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.775290 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e2b8ea3-aafa-4633-8fe0-97da24cd958e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.776133 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e2b8ea3-aafa-4633-8fe0-97da24cd958e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.977077 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-711ae6f7-02b6-4167-b433-e5178d9054fa tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:17.979804 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-711ae6f7-02b6-4167-b433-e5178d9054fa tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:17.989759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-711ae6f7-02b6-4167-b433-e5178d9054fa tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.990496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-711ae6f7-02b6-4167-b433-e5178d9054fa tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:17.991458 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-711ae6f7-02b6-4167-b433-e5178d9054fa tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:17.992014 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-711ae6f7-02b6-4167-b433-e5178d9054fa tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.131148 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5e2b8ea3-aafa-4633-8fe0-97da24cd958e tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "DELETE /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/os-volume_attachments/b2909f4e-c9c1-4136-bbdf-8086bc4f3910" status: 202 len: 0 microversion: 2.20 time: 0.368807 Jan 28 02:03:18.135642 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 489/984] 10.222.0.96 () {60 vars in 1456 bytes} [Fri Jan 28 02:03:17 2022] DELETE /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/os-volume_attachments/b2909f4e-c9c1-4136-bbdf-8086bc4f3910 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:03:18.205855 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cbc1383e-cd20-4017-b8bb-2f31b66a5263 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:18.206435 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cbc1383e-cd20-4017-b8bb-2f31b66a5263 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:18.214629 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cbc1383e-cd20-4017-b8bb-2f31b66a5263 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.215422 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cbc1383e-cd20-4017-b8bb-2f31b66a5263 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.216233 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cbc1383e-cd20-4017-b8bb-2f31b66a5263 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.216949 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cbc1383e-cd20-4017-b8bb-2f31b66a5263 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.506815 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cbc1383e-cd20-4017-b8bb-2f31b66a5263 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action" status: 202 len: 0 microversion: 2.20 time: 0.305826 Jan 28 02:03:18.507685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 490/985] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Jan 28 02:03:18 2022] POST /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:03:18.519068 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:18.519640 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:18.527547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.528498 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.529707 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:18.530384 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:18.547292 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-711ae6f7-02b6-4167-b433-e5178d9054fa tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:18.554680 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-711ae6f7-02b6-4167-b433-e5178d9054fa tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1573 microversion: 2.1 time: 0.584761 Jan 28 02:03:18.558758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 496/986] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:17 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1573 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:18.744651 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:18.755322 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:18.757344 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:18.758831 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c6c26237-1ce6-4f08-be38-10afc7065966 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1673 microversion: 2.20 time: 0.243806 Jan 28 02:03:18.760087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 491/987] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:18 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1673 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:03:19.256113 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-a6b89fea-1c76-435c-96b8-cb716d923221 req-d89ffd9f-623d-4e83-bcfd-893c3b4fc03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e2f5bb-ea79-4637-b7a5-5f4d10aebe58", "name": "network-vif-unplugged", "status": "completed", "tag": "b3df727d-fb39-47e3-88bf-cdef71b67bf5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:19.261027 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:19.261027 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:03:19.270495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-a6b89fea-1c76-435c-96b8-cb716d923221 req-d89ffd9f-623d-4e83-bcfd-893c3b4fc03e service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.271361 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-a6b89fea-1c76-435c-96b8-cb716d923221 req-d89ffd9f-623d-4e83-bcfd-893c3b4fc03e service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.285406 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.compute.server_external_events [req-a6b89fea-1c76-435c-96b8-cb716d923221 req-d89ffd9f-623d-4e83-bcfd-893c3b4fc03e service nova] Unable to find a host for instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58. Dropping event network-vif-unplugged {{(pid=115798) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 28 02:03:19.286618 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-a6b89fea-1c76-435c-96b8-cb716d923221 req-d89ffd9f-623d-4e83-bcfd-893c3b4fc03e service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036406 Jan 28 02:03:19.288138 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 497/988] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 28 02:03:19.579364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a9902faf-b283-4335-a707-7d670c6d7ccf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:19.580775 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a9902faf-b283-4335-a707-7d670c6d7ccf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:19.586805 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9902faf-b283-4335-a707-7d670c6d7ccf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.588143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9902faf-b283-4335-a707-7d670c6d7ccf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.589608 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9902faf-b283-4335-a707-7d670c6d7ccf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.590515 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9902faf-b283-4335-a707-7d670c6d7ccf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.754516 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a9902faf-b283-4335-a707-7d670c6d7ccf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:19.764543 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a9902faf-b283-4335-a707-7d670c6d7ccf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1560 microversion: 2.1 time: 0.192677 Jan 28 02:03:19.766025 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 492/989] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:19 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:19.785057 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:19.786191 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:19.800304 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.800871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:19.801880 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:19.802480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:20.043758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:20.051958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:20.053665 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:20.055698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-08177ec4-403b-4560-9154-500799d18c38 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.277162 Jan 28 02:03:20.070175 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 498/990] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:19 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:21.082216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:21.082840 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:21.091713 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.092169 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.093198 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:21.093828 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:21.332236 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:21.344230 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:21.346781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:21.348257 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dc67174e-ed4e-4887-8375-a2e5113125e3 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.271155 Jan 28 02:03:21.363297 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 493/991] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:21 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:22.367529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:22.368131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:22.376838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:22.379028 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:22.379979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:22.381958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:22.580646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:22.590038 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:22.592283 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:22.593774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4fb08842-39ea-43eb-953a-371507cc171c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.230034 Jan 28 02:03:22.597186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 499/992] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:22 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:23.614579 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:23.615902 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:23.629204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:23.629938 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:23.631087 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:23.633383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:23.910553 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:23.920505 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:23.923835 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:23.925775 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8c302173-8095-4b6a-b31b-386c4bf21c05 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.315892 Jan 28 02:03:23.927102 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 494/993] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:23 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:24.944645 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:24.945919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:24.960505 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:24.961236 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:24.983979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:24.984679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:25.421181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:25.429578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:25.436696 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:25.438243 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4d97bca9-2137-42c4-bb58-75f606689ab8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.497320 Jan 28 02:03:25.441311 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 500/994] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:24 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:26.461205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:26.461890 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:26.473996 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.476999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.480263 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:26.482017 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:26.958806 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:26.968047 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:26.969712 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:26.971145 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c82c655a-97ba-4f50-9844-9e6901149251 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.514067 Jan 28 02:03:26.972503 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 495/995] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:26 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:27.990994 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:27.992431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:28.006421 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:28.007268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:28.008734 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:28.009572 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:28.241716 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:28.251269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:28.255578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:28.257861 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ee2a40ae-4602-4dbc-a9cc-0b6b0887e6ed tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.271967 Jan 28 02:03:28.258449 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 501/996] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:27 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:29.276920 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:29.277571 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:29.289554 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:29.290417 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:29.291705 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:29.292435 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:29.529185 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:29.539026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:29.557265 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:29.558735 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c1e72ff6-23b7-4e77-9ea6-ce337271d729 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.286699 Jan 28 02:03:29.561633 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 496/997] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:29 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:30.578992 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:30.579680 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:30.594405 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.595246 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.595739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:30.596398 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:30.878715 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:30.887961 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:30.889797 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:30.891245 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-021553b9-8a4a-4a8f-970a-25119ac8fa23 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.316100 Jan 28 02:03:30.891968 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 502/998] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:30 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:31.910943 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:31.912311 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:31.918702 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.919309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:31.920160 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:31.921273 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:32.060475 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:32.071065 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:32.073704 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:32.075321 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cb94c6c1-9c3a-4fc6-9b02-15deb75904da tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.168182 Jan 28 02:03:32.076043 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 497/999] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:31 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:33.095734 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:33.097813 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:33.105047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:33.105846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:33.107120 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:33.107774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:33.345450 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:33.354522 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:33.358923 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:33.367196 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0a8eabed-7cf4-473a-84e1-5fa1175dd633 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.275254 Jan 28 02:03:33.368348 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 503/1000] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:33 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:34.388205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:34.388753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:34.397331 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.400106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.402441 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:34.403831 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:34.627539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:34.636762 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:34.638641 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:34.640189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8569d21b-be2b-46ed-a60b-e198a054b470 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.256387 Jan 28 02:03:34.641646 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 498/1001] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:34 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:35.320015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-f5252577-2a02-48fd-ab1e-154d92d7c974 req-05aa8436-a35d-47c6-ad07-c73b5cf0f5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e2f5bb-ea79-4637-b7a5-5f4d10aebe58", "name": "network-vif-plugged", "status": "completed", "tag": "b3df727d-fb39-47e3-88bf-cdef71b67bf5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:35.323201 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:35.323201 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:03:35.334859 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-f5252577-2a02-48fd-ab1e-154d92d7c974 req-05aa8436-a35d-47c6-ad07-c73b5cf0f5c7 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:35.335592 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-f5252577-2a02-48fd-ab1e-154d92d7c974 req-05aa8436-a35d-47c6-ad07-c73b5cf0f5c7 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:35.351106 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-f5252577-2a02-48fd-ab1e-154d92d7c974 req-05aa8436-a35d-47c6-ad07-c73b5cf0f5c7 service nova] Creating event network-vif-plugged:b3df727d-fb39-47e3-88bf-cdef71b67bf5 for instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 on hv-cinder-82497 Jan 28 02:03:35.363414 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-f5252577-2a02-48fd-ab1e-154d92d7c974 req-05aa8436-a35d-47c6-ad07-c73b5cf0f5c7 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046854 Jan 28 02:03:35.364595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 504/1002] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:35.660901 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:35.661573 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:35.669551 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:35.670137 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:35.671029 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:35.671566 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:35.822591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:35.831283 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:35.833216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:35.834467 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0010371e-de59-4a5c-bab0-8e7d56fd8b64 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.178458 Jan 28 02:03:35.835089 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 499/1003] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:35 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:36.856415 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:36.857054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:36.865603 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:36.866435 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:36.867521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:36.868161 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:37.010706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:37.019615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:37.021133 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:37.022508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-67325117-0964-478d-9e76-b1fd9c7888f8 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1731 microversion: 2.20 time: 0.170795 Jan 28 02:03:37.023262 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 505/1004] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:36 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:38.043758 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:38.044477 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:38.050710 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:38.051238 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:38.052332 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:38.053004 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:38.186217 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:38.196094 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:38.198275 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:38.199575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7c25c836-2171-470f-af3f-1d2ee7687f71 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1718 microversion: 2.20 time: 0.160463 Jan 28 02:03:38.200291 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 500/1005] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:03:38 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:03:38.417168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4fee23ad-591c-4cb6-9953-d5ef79681353 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Action: 'create', calling method: .version_select at 0x7f523f242160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-373663098"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:38.434167 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-4fee23ad-591c-4cb6-9953-d5ef79681353 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Getting quotas for project 4f88b3ae05934fd8836d7e90cad61a53. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:03:38.437783 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-4fee23ad-591c-4cb6-9953-d5ef79681353 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Getting quotas for user 2668984632674ed6b3d343244d92c623 and project 4f88b3ae05934fd8836d7e90cad61a53. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:03:38.702806 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-4fee23ad-591c-4cb6-9953-d5ef79681353 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Getting quotas for project 4f88b3ae05934fd8836d7e90cad61a53. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:03:38.706296 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-4fee23ad-591c-4cb6-9953-d5ef79681353 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Getting quotas for user 2668984632674ed6b3d343244d92c623 and project 4f88b3ae05934fd8836d7e90cad61a53. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:03:38.719424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4fee23ad-591c-4cb6-9953-d5ef79681353 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.306736 Jan 28 02:03:38.720017 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 506/1006] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Jan 28 02:03:38 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:38.767569 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-409745151", "imageRef": "0ea2daec-5810-48d6-9449-c6ba48655286", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-373663098", "networks": [{"uuid": "68dfca5a-5c03-4384-945b-f965b0dfdf1c"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:38.820274 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] validate_networks() for [('68dfca5a-5c03-4384-945b-f965b0dfdf1c', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:03:39.183997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:03:39.184506 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:03:39.184944 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:03:39.185355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:03:39.185764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:03:39.195176 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:39.195648 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:39.197309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:39.197752 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:39.213871 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Getting quotas for project 4f88b3ae05934fd8836d7e90cad61a53. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:03:39.217694 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Getting quotas for user 2668984632674ed6b3d343244d92c623 and project 4f88b3ae05934fd8836d7e90cad61a53. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:03:39.228654 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:03:39.230995 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ea2daec-5810-48d6-9449-c6ba48655286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:03:39.275567 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c3cba177-401b-4273-97a7-6dc897d44e57 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511544 Jan 28 02:03:39.276122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 501/1007] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 02:03:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:03:39.285865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-beaa68f7-043b-4161-9d4a-3c3fd460e22f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:39.286469 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-beaa68f7-043b-4161-9d4a-3c3fd460e22f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:39.337281 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-beaa68f7-043b-4161-9d4a-3c3fd460e22f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:39.343783 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-beaa68f7-043b-4161-9d4a-3c3fd460e22f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1257 microversion: 2.1 time: 0.061553 Jan 28 02:03:39.344541 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 507/1008] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:39 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1257 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:40.362288 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9f54b2fc-2d9e-4c94-935b-5be10dc2c612 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:40.362993 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9f54b2fc-2d9e-4c94-935b-5be10dc2c612 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:40.369877 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f54b2fc-2d9e-4c94-935b-5be10dc2c612 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:40.370321 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f54b2fc-2d9e-4c94-935b-5be10dc2c612 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:40.371276 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f54b2fc-2d9e-4c94-935b-5be10dc2c612 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:40.371709 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f54b2fc-2d9e-4c94-935b-5be10dc2c612 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:40.447056 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9f54b2fc-2d9e-4c94-935b-5be10dc2c612 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:40.455462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9f54b2fc-2d9e-4c94-935b-5be10dc2c612 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1327 microversion: 2.1 time: 0.098273 Jan 28 02:03:40.456582 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 502/1009] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:40 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:41.473877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ce5056f9-77c5-4b9c-bd84-cfc33922ec00 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:41.475279 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ce5056f9-77c5-4b9c-bd84-cfc33922ec00 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:41.484746 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce5056f9-77c5-4b9c-bd84-cfc33922ec00 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.485367 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce5056f9-77c5-4b9c-bd84-cfc33922ec00 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.486237 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce5056f9-77c5-4b9c-bd84-cfc33922ec00 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:41.486671 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce5056f9-77c5-4b9c-bd84-cfc33922ec00 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:41.634603 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ce5056f9-77c5-4b9c-bd84-cfc33922ec00 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:41.643262 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ce5056f9-77c5-4b9c-bd84-cfc33922ec00 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.173437 Jan 28 02:03:41.643846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 508/1010] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:41 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:42.661593 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8119e33d-a04d-4db5-8543-45dcf402d1d5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:42.662201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8119e33d-a04d-4db5-8543-45dcf402d1d5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:42.669025 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8119e33d-a04d-4db5-8543-45dcf402d1d5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:42.669477 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8119e33d-a04d-4db5-8543-45dcf402d1d5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:42.670251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8119e33d-a04d-4db5-8543-45dcf402d1d5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:42.670685 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8119e33d-a04d-4db5-8543-45dcf402d1d5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:42.797226 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8119e33d-a04d-4db5-8543-45dcf402d1d5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:42.805064 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8119e33d-a04d-4db5-8543-45dcf402d1d5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.146935 Jan 28 02:03:42.805714 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 503/1011] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:42 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:43.821643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f6c20565-cfb2-4ea8-89df-51372b6e0f15 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:43.822182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f6c20565-cfb2-4ea8-89df-51372b6e0f15 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:43.828954 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6c20565-cfb2-4ea8-89df-51372b6e0f15 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:43.829681 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6c20565-cfb2-4ea8-89df-51372b6e0f15 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:43.830680 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6c20565-cfb2-4ea8-89df-51372b6e0f15 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:43.831342 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6c20565-cfb2-4ea8-89df-51372b6e0f15 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:43.968325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f6c20565-cfb2-4ea8-89df-51372b6e0f15 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:43.975707 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f6c20565-cfb2-4ea8-89df-51372b6e0f15 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.157794 Jan 28 02:03:43.976269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 509/1012] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:43 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:44.993640 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-702dfeab-ab15-49cb-9667-4a48fb4036af tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:44.994319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-702dfeab-ab15-49cb-9667-4a48fb4036af tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:45.000720 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-702dfeab-ab15-49cb-9667-4a48fb4036af tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:45.001199 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-702dfeab-ab15-49cb-9667-4a48fb4036af tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:45.001982 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-702dfeab-ab15-49cb-9667-4a48fb4036af tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:45.002419 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-702dfeab-ab15-49cb-9667-4a48fb4036af tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:45.133116 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-702dfeab-ab15-49cb-9667-4a48fb4036af tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:45.142603 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-702dfeab-ab15-49cb-9667-4a48fb4036af tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.153127 Jan 28 02:03:45.143379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 504/1013] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:44 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:46.045275 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dda70a49-76e4-456f-9c09-0bf2f4b96470 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:46.045863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dda70a49-76e4-456f-9c09-0bf2f4b96470 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:46.051483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dda70a49-76e4-456f-9c09-0bf2f4b96470 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:46.051926 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dda70a49-76e4-456f-9c09-0bf2f4b96470 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:46.052719 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dda70a49-76e4-456f-9c09-0bf2f4b96470 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:46.053172 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dda70a49-76e4-456f-9c09-0bf2f4b96470 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:46.144224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-dda70a49-76e4-456f-9c09-0bf2f4b96470 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lazy-loading 'services' on Instance uuid b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:03:46.160540 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-27f9a900-481c-4984-9b1f-7f772580a0c6 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:46.161181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-27f9a900-481c-4984-9b1f-7f772580a0c6 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:46.170504 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27f9a900-481c-4984-9b1f-7f772580a0c6 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:46.173106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27f9a900-481c-4984-9b1f-7f772580a0c6 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:46.174021 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27f9a900-481c-4984-9b1f-7f772580a0c6 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:46.174488 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27f9a900-481c-4984-9b1f-7f772580a0c6 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:46.237787 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dda70a49-76e4-456f-9c09-0bf2f4b96470 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/os-volume_attachments/df45659d-49c3-4479-9ddf-5d43b10804bd" status: 202 len: 0 microversion: 2.1 time: 0.196600 Jan 28 02:03:46.241759 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 510/1014] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:03:46 2022] DELETE /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/os-volume_attachments/df45659d-49c3-4479-9ddf-5d43b10804bd => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:03:46.342127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-27f9a900-481c-4984-9b1f-7f772580a0c6 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:46.350357 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-27f9a900-481c-4984-9b1f-7f772580a0c6 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.194228 Jan 28 02:03:46.360286 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 505/1015] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:46 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:47.368031 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-05cbdaa4-2f23-42db-955b-a0a97cebb82d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:47.368764 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-05cbdaa4-2f23-42db-955b-a0a97cebb82d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:47.375768 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05cbdaa4-2f23-42db-955b-a0a97cebb82d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.376198 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05cbdaa4-2f23-42db-955b-a0a97cebb82d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.377010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05cbdaa4-2f23-42db-955b-a0a97cebb82d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.377442 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05cbdaa4-2f23-42db-955b-a0a97cebb82d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.511624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-05cbdaa4-2f23-42db-955b-a0a97cebb82d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:47.519084 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-05cbdaa4-2f23-42db-955b-a0a97cebb82d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.155098 Jan 28 02:03:47.519844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 511/1016] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:47 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:48.535443 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-341eed74-c202-42b6-a196-aa4ffb71a8d0 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:48.536055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-341eed74-c202-42b6-a196-aa4ffb71a8d0 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:48.542038 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-341eed74-c202-42b6-a196-aa4ffb71a8d0 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:48.542565 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-341eed74-c202-42b6-a196-aa4ffb71a8d0 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.543360 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-341eed74-c202-42b6-a196-aa4ffb71a8d0 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:48.543795 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-341eed74-c202-42b6-a196-aa4ffb71a8d0 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.669173 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-341eed74-c202-42b6-a196-aa4ffb71a8d0 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:48.677228 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-341eed74-c202-42b6-a196-aa4ffb71a8d0 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.145562 Jan 28 02:03:48.677803 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 506/1017] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:48 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:49.696789 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7a0c9e38-c2ff-47ce-93a1-ecc8db5b7d3b tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:49.697451 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7a0c9e38-c2ff-47ce-93a1-ecc8db5b7d3b tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:49.704132 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7a0c9e38-c2ff-47ce-93a1-ecc8db5b7d3b tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:49.704725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7a0c9e38-c2ff-47ce-93a1-ecc8db5b7d3b tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:49.705591 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7a0c9e38-c2ff-47ce-93a1-ecc8db5b7d3b tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:49.706004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7a0c9e38-c2ff-47ce-93a1-ecc8db5b7d3b tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.068461 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7a0c9e38-c2ff-47ce-93a1-ecc8db5b7d3b tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:50.079727 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7a0c9e38-c2ff-47ce-93a1-ecc8db5b7d3b tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.386559 Jan 28 02:03:50.080555 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 512/1018] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:49 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:50.459631 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-2b25c23c-9883-42a1-b901-61bce2706e5d req-2f4c8026-c1d8-4d64-9ab5-240c0948e16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6d5ac-655f-45b3-838b-02216f1bb988", "tag": "f32c519b-1b2d-4daa-aab9-7451f40e2300"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:50.462285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:50.462285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:03:50.471503 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-2b25c23c-9883-42a1-b901-61bce2706e5d req-2f4c8026-c1d8-4d64-9ab5-240c0948e16b service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.472385 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-2b25c23c-9883-42a1-b901-61bce2706e5d req-2f4c8026-c1d8-4d64-9ab5-240c0948e16b service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.486225 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-2b25c23c-9883-42a1-b901-61bce2706e5d req-2f4c8026-c1d8-4d64-9ab5-240c0948e16b service nova] Creating event network-changed:f32c519b-1b2d-4daa-aab9-7451f40e2300 for instance 46b6d5ac-655f-45b3-838b-02216f1bb988 on hv-cinder-82497 Jan 28 02:03:50.492398 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-2b25c23c-9883-42a1-b901-61bce2706e5d req-2f4c8026-c1d8-4d64-9ab5-240c0948e16b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036387 Jan 28 02:03:50.493466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 507/1019] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:50.583118 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9304e7a5-c420-4aec-afc6-3fab88d68eef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:50.591737 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9304e7a5-c420-4aec-afc6-3fab88d68eef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.592559 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9304e7a5-c420-4aec-afc6-3fab88d68eef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.617544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9304e7a5-c420-4aec-afc6-3fab88d68eef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Going to try to stop instance {{(pid=115798) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Jan 28 02:03:50.662793 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9304e7a5-c420-4aec-afc6-3fab88d68eef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 202 len: 0 microversion: 2.1 time: 0.083508 Jan 28 02:03:50.663571 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 513/1020] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:03:50 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:03:50.674297 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4f71f2e9-7230-4406-8bc3-87e539597f9b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:50.675310 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4f71f2e9-7230-4406-8bc3-87e539597f9b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:50.684194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f71f2e9-7230-4406-8bc3-87e539597f9b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.684783 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f71f2e9-7230-4406-8bc3-87e539597f9b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.685658 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f71f2e9-7230-4406-8bc3-87e539597f9b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:50.686311 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f71f2e9-7230-4406-8bc3-87e539597f9b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:50.874833 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4f71f2e9-7230-4406-8bc3-87e539597f9b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:50.882001 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4f71f2e9-7230-4406-8bc3-87e539597f9b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.213630 Jan 28 02:03:50.882562 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 508/1021] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:50 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:51.099564 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-66381a61-3042-4ea4-97ee-07c527122f3a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:51.100280 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-66381a61-3042-4ea4-97ee-07c527122f3a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:51.107249 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66381a61-3042-4ea4-97ee-07c527122f3a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:51.107868 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66381a61-3042-4ea4-97ee-07c527122f3a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:51.108755 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66381a61-3042-4ea4-97ee-07c527122f3a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:51.109193 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66381a61-3042-4ea4-97ee-07c527122f3a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:51.271252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-66381a61-3042-4ea4-97ee-07c527122f3a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:51.279696 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-66381a61-3042-4ea4-97ee-07c527122f3a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.184482 Jan 28 02:03:51.280255 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 514/1022] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:51 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:51.899751 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e14df18d-fc3d-4f7c-a637-34ae550dff9c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:51.900362 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e14df18d-fc3d-4f7c-a637-34ae550dff9c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:51.907220 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e14df18d-fc3d-4f7c-a637-34ae550dff9c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:51.907666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e14df18d-fc3d-4f7c-a637-34ae550dff9c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:51.908432 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e14df18d-fc3d-4f7c-a637-34ae550dff9c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:51.908889 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e14df18d-fc3d-4f7c-a637-34ae550dff9c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.035019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e14df18d-fc3d-4f7c-a637-34ae550dff9c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:52.042713 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e14df18d-fc3d-4f7c-a637-34ae550dff9c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.147405 Jan 28 02:03:52.043308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 509/1023] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:51 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:52.296521 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d08709bc-fe34-45fb-ab15-ee14c6d41eee tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:52.297093 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d08709bc-fe34-45fb-ab15-ee14c6d41eee tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:52.302824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d08709bc-fe34-45fb-ab15-ee14c6d41eee tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.303265 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d08709bc-fe34-45fb-ab15-ee14c6d41eee tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.304019 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d08709bc-fe34-45fb-ab15-ee14c6d41eee tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:52.304446 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d08709bc-fe34-45fb-ab15-ee14c6d41eee tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:52.423588 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d08709bc-fe34-45fb-ab15-ee14c6d41eee tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:52.430710 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d08709bc-fe34-45fb-ab15-ee14c6d41eee tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.137887 Jan 28 02:03:52.431268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 515/1024] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:52 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:53.060262 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-11d37fc6-f426-4ad4-a556-017babc8accb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:53.060906 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-11d37fc6-f426-4ad4-a556-017babc8accb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:53.066797 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11d37fc6-f426-4ad4-a556-017babc8accb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.067269 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11d37fc6-f426-4ad4-a556-017babc8accb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.068041 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11d37fc6-f426-4ad4-a556-017babc8accb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.068477 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11d37fc6-f426-4ad4-a556-017babc8accb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.192767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-11d37fc6-f426-4ad4-a556-017babc8accb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:53.200617 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-11d37fc6-f426-4ad4-a556-017babc8accb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.144264 Jan 28 02:03:53.201226 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 510/1025] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:53 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:53.447336 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-90dae941-85a3-446e-8ed5-0fc7fc04b3ad tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:53.448941 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-90dae941-85a3-446e-8ed5-0fc7fc04b3ad tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:53.454785 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-90dae941-85a3-446e-8ed5-0fc7fc04b3ad tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.455237 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-90dae941-85a3-446e-8ed5-0fc7fc04b3ad tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.456009 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-90dae941-85a3-446e-8ed5-0fc7fc04b3ad tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:53.456445 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-90dae941-85a3-446e-8ed5-0fc7fc04b3ad tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:53.583498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-90dae941-85a3-446e-8ed5-0fc7fc04b3ad tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:53.591280 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-90dae941-85a3-446e-8ed5-0fc7fc04b3ad tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.147588 Jan 28 02:03:53.591841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 516/1026] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:53 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:54.217987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7ac56de9-b2e2-4588-826d-eb864e0234d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:54.218586 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7ac56de9-b2e2-4588-826d-eb864e0234d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:54.224356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ac56de9-b2e2-4588-826d-eb864e0234d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:54.224820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ac56de9-b2e2-4588-826d-eb864e0234d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:54.225690 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ac56de9-b2e2-4588-826d-eb864e0234d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:54.226123 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7ac56de9-b2e2-4588-826d-eb864e0234d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:54.348778 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7ac56de9-b2e2-4588-826d-eb864e0234d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:54.356605 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7ac56de9-b2e2-4588-826d-eb864e0234d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.142537 Jan 28 02:03:54.357199 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 511/1027] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:54 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:54.609848 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ff98a2d6-b165-444c-bf0e-5eafcdc3f967 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:54.610446 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ff98a2d6-b165-444c-bf0e-5eafcdc3f967 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:54.617106 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff98a2d6-b165-444c-bf0e-5eafcdc3f967 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:54.617585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff98a2d6-b165-444c-bf0e-5eafcdc3f967 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:54.618339 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff98a2d6-b165-444c-bf0e-5eafcdc3f967 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:54.618830 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff98a2d6-b165-444c-bf0e-5eafcdc3f967 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:54.751152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ff98a2d6-b165-444c-bf0e-5eafcdc3f967 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:54.758478 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ff98a2d6-b165-444c-bf0e-5eafcdc3f967 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.153758 Jan 28 02:03:54.759043 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 517/1028] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:54 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:55.346172 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-e718a47f-eec6-4131-8337-3c358ebf7ffe req-4ece53b1-94ee-4ddb-98ca-3ea0efde8864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b6d5ac-655f-45b3-838b-02216f1bb988", "name": "network-vif-plugged", "status": "completed", "tag": "f32c519b-1b2d-4daa-aab9-7451f40e2300"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:55.347713 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:55.347713 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:03:55.356275 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-e718a47f-eec6-4131-8337-3c358ebf7ffe req-4ece53b1-94ee-4ddb-98ca-3ea0efde8864 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.356837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-e718a47f-eec6-4131-8337-3c358ebf7ffe req-4ece53b1-94ee-4ddb-98ca-3ea0efde8864 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.370103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-e718a47f-eec6-4131-8337-3c358ebf7ffe req-4ece53b1-94ee-4ddb-98ca-3ea0efde8864 service nova] Creating event network-vif-plugged:f32c519b-1b2d-4daa-aab9-7451f40e2300 for instance 46b6d5ac-655f-45b3-838b-02216f1bb988 on hv-cinder-82497 Jan 28 02:03:55.373555 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4edbe991-56c4-4cae-b8f8-1b4d15995f16 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:55.374172 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4edbe991-56c4-4cae-b8f8-1b4d15995f16 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:55.375389 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-e718a47f-eec6-4131-8337-3c358ebf7ffe req-4ece53b1-94ee-4ddb-98ca-3ea0efde8864 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Jan 28 02:03:55.376207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 512/1029] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:55.381162 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4edbe991-56c4-4cae-b8f8-1b4d15995f16 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.381678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4edbe991-56c4-4cae-b8f8-1b4d15995f16 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.382912 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4edbe991-56c4-4cae-b8f8-1b4d15995f16 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.383349 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4edbe991-56c4-4cae-b8f8-1b4d15995f16 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.537786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4edbe991-56c4-4cae-b8f8-1b4d15995f16 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:55.548847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4edbe991-56c4-4cae-b8f8-1b4d15995f16 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.176044 Jan 28 02:03:55.548847 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 518/1030] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:55 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:03:55.776826 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-051e8ba2-ae0a-4cbc-8eed-783b458ee226 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:55.778152 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-051e8ba2-ae0a-4cbc-8eed-783b458ee226 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:55.784645 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-051e8ba2-ae0a-4cbc-8eed-783b458ee226 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.785114 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-051e8ba2-ae0a-4cbc-8eed-783b458ee226 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.786216 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-051e8ba2-ae0a-4cbc-8eed-783b458ee226 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:55.786782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-051e8ba2-ae0a-4cbc-8eed-783b458ee226 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:55.920773 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-051e8ba2-ae0a-4cbc-8eed-783b458ee226 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:55.928433 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-051e8ba2-ae0a-4cbc-8eed-783b458ee226 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1357 microversion: 2.1 time: 0.156188 Jan 28 02:03:55.929036 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 513/1031] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:55 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:56.563449 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9c670596-3a4c-470d-b1c2-1761f13e196e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:56.564051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9c670596-3a4c-470d-b1c2-1761f13e196e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:56.569994 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c670596-3a4c-470d-b1c2-1761f13e196e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.570452 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c670596-3a4c-470d-b1c2-1761f13e196e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.571221 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c670596-3a4c-470d-b1c2-1761f13e196e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.571659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c670596-3a4c-470d-b1c2-1761f13e196e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.701809 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9c670596-3a4c-470d-b1c2-1761f13e196e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:56.709139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9c670596-3a4c-470d-b1c2-1761f13e196e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.149215 Jan 28 02:03:56.709704 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 519/1032] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:56 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:56.946086 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-76fff792-3b95-40fd-8e0a-2cf8d401c807 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:56.947281 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-76fff792-3b95-40fd-8e0a-2cf8d401c807 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:56.954219 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76fff792-3b95-40fd-8e0a-2cf8d401c807 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.954666 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76fff792-3b95-40fd-8e0a-2cf8d401c807 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:56.955440 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76fff792-3b95-40fd-8e0a-2cf8d401c807 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:56.955874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76fff792-3b95-40fd-8e0a-2cf8d401c807 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.081919 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-76fff792-3b95-40fd-8e0a-2cf8d401c807 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:57.089384 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-76fff792-3b95-40fd-8e0a-2cf8d401c807 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1546 microversion: 2.1 time: 0.147051 Jan 28 02:03:57.091558 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 514/1033] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:56 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:57.112729 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7026b589-7612-40db-ae11-7bc286f6fdfa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:57.113537 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7026b589-7612-40db-ae11-7bc286f6fdfa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:57.120991 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7026b589-7612-40db-ae11-7bc286f6fdfa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.121446 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7026b589-7612-40db-ae11-7bc286f6fdfa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.122220 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7026b589-7612-40db-ae11-7bc286f6fdfa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.122653 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7026b589-7612-40db-ae11-7bc286f6fdfa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.258024 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7026b589-7612-40db-ae11-7bc286f6fdfa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:57.266533 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7026b589-7612-40db-ae11-7bc286f6fdfa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1546 microversion: 2.1 time: 0.157679 Jan 28 02:03:57.267111 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 520/1034] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:57 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:57.285732 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:57.290871 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:57.290871 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:03:57.291848 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:57.292601 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Searching by: {'deleted': False, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53'} {{(pid=115797) get_all /opt/stack/nova/nova/compute/api.py:2905}} Jan 28 02:03:57.299465 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.299908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.300705 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.301170 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.402913 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.multi_cell_list [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115797) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jan 28 02:03:57.506737 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-700f213f-2e43-4fb6-9973-a521d672baea tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.226501 Jan 28 02:03:57.507336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 515/1035] 10.222.0.96 () {58 vars in 1124 bytes} [Fri Jan 28 02:03:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:03:57.517885 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cef112d2-3833-4510-94a9-08960fcb3f2e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:57.518496 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cef112d2-3833-4510-94a9-08960fcb3f2e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:57.524252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cef112d2-3833-4510-94a9-08960fcb3f2e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.524707 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cef112d2-3833-4510-94a9-08960fcb3f2e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.525509 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cef112d2-3833-4510-94a9-08960fcb3f2e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.525950 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cef112d2-3833-4510-94a9-08960fcb3f2e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.654867 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cef112d2-3833-4510-94a9-08960fcb3f2e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:57.662614 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cef112d2-3833-4510-94a9-08960fcb3f2e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1546 microversion: 2.1 time: 0.148435 Jan 28 02:03:57.663221 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 521/1036] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:57 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:57.727353 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bffa08bf-1212-447f-9c16-a97f650a0e57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:57.728082 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bffa08bf-1212-447f-9c16-a97f650a0e57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:57.734851 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bffa08bf-1212-447f-9c16-a97f650a0e57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.735347 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bffa08bf-1212-447f-9c16-a97f650a0e57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.736175 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bffa08bf-1212-447f-9c16-a97f650a0e57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:57.736623 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bffa08bf-1212-447f-9c16-a97f650a0e57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:57.868876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bffa08bf-1212-447f-9c16-a97f650a0e57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:57.877514 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bffa08bf-1212-447f-9c16-a97f650a0e57 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.153785 Jan 28 02:03:57.887960 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 516/1037] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:57 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:58.895621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5c3f6741-6b4c-415d-a58a-155cf5abf761 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:58.896206 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5c3f6741-6b4c-415d-a58a-155cf5abf761 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:58.901880 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5c3f6741-6b4c-415d-a58a-155cf5abf761 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:58.903021 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5c3f6741-6b4c-415d-a58a-155cf5abf761 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:58.903786 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5c3f6741-6b4c-415d-a58a-155cf5abf761 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:58.904217 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5c3f6741-6b4c-415d-a58a-155cf5abf761 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.033819 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5c3f6741-6b4c-415d-a58a-155cf5abf761 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:03:59.043642 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5c3f6741-6b4c-415d-a58a-155cf5abf761 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.151109 Jan 28 02:03:59.044230 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 522/1038] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:03:58 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:03:59.217078 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9a3e3d33-200b-4750-ae2d-8c766e04a5fb tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a0d8e57-048e-4c30-bb4b-eccacb699dbd"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:03:59.218363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9a3e3d33-200b-4750-ae2d-8c766e04a5fb tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:03:59.224561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d33-200b-4750-ae2d-8c766e04a5fb tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.225089 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d33-200b-4750-ae2d-8c766e04a5fb tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.225891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d33-200b-4750-ae2d-8c766e04a5fb tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:59.226829 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d33-200b-4750-ae2d-8c766e04a5fb tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:59.512124 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9a3e3d33-200b-4750-ae2d-8c766e04a5fb tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "POST /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299291 Jan 28 02:03:59.512738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 517/1039] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 02:03:59 2022] POST /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:00.063497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-310d4107-746d-4ead-9fee-37b797ec16c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:00.064114 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-310d4107-746d-4ead-9fee-37b797ec16c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:00.070262 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-310d4107-746d-4ead-9fee-37b797ec16c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:00.070795 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-310d4107-746d-4ead-9fee-37b797ec16c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:00.071577 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-310d4107-746d-4ead-9fee-37b797ec16c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:00.072019 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-310d4107-746d-4ead-9fee-37b797ec16c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:00.206328 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-310d4107-746d-4ead-9fee-37b797ec16c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:00.214494 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-310d4107-746d-4ead-9fee-37b797ec16c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.154971 Jan 28 02:04:00.215391 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 523/1040] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:00 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:01.232511 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8fb5d9da-2e05-41e1-99af-8f2ea4a98b9a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:01.233236 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8fb5d9da-2e05-41e1-99af-8f2ea4a98b9a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:01.240296 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8fb5d9da-2e05-41e1-99af-8f2ea4a98b9a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:01.240747 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8fb5d9da-2e05-41e1-99af-8f2ea4a98b9a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.241552 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8fb5d9da-2e05-41e1-99af-8f2ea4a98b9a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:01.241989 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8fb5d9da-2e05-41e1-99af-8f2ea4a98b9a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.367350 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8fb5d9da-2e05-41e1-99af-8f2ea4a98b9a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:01.375888 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8fb5d9da-2e05-41e1-99af-8f2ea4a98b9a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.148101 Jan 28 02:04:01.376471 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 518/1041] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:01 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:02.393340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c3842f46-42b9-4c61-9a6e-bbaad08da330 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:02.393883 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c3842f46-42b9-4c61-9a6e-bbaad08da330 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:02.399747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3842f46-42b9-4c61-9a6e-bbaad08da330 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.400192 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3842f46-42b9-4c61-9a6e-bbaad08da330 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.400983 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3842f46-42b9-4c61-9a6e-bbaad08da330 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.401417 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3842f46-42b9-4c61-9a6e-bbaad08da330 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.521391 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c3842f46-42b9-4c61-9a6e-bbaad08da330 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:02.529313 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c3842f46-42b9-4c61-9a6e-bbaad08da330 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.139683 Jan 28 02:04:02.529885 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 524/1042] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:02 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:03.547261 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1bc5a2d4-3c26-4407-88bb-fa7659345488 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:03.547868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1bc5a2d4-3c26-4407-88bb-fa7659345488 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:03.554269 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1bc5a2d4-3c26-4407-88bb-fa7659345488 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.554718 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1bc5a2d4-3c26-4407-88bb-fa7659345488 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.555486 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1bc5a2d4-3c26-4407-88bb-fa7659345488 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:03.555918 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1bc5a2d4-3c26-4407-88bb-fa7659345488 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:03.683777 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1bc5a2d4-3c26-4407-88bb-fa7659345488 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:03.691186 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1bc5a2d4-3c26-4407-88bb-fa7659345488 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.148447 Jan 28 02:04:03.691753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 519/1043] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:03 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:04.708460 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4730892a-6569-444f-aa50-c9d5f8a39695 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:04.709088 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4730892a-6569-444f-aa50-c9d5f8a39695 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:04.714934 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4730892a-6569-444f-aa50-c9d5f8a39695 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.715437 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4730892a-6569-444f-aa50-c9d5f8a39695 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.716219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4730892a-6569-444f-aa50-c9d5f8a39695 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:04.716682 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4730892a-6569-444f-aa50-c9d5f8a39695 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:04.838553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4730892a-6569-444f-aa50-c9d5f8a39695 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:04.846486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4730892a-6569-444f-aa50-c9d5f8a39695 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.141623 Jan 28 02:04:04.847052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 525/1044] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:04 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:05.863310 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ff16c505-c510-441a-86dd-b8359b37b64a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:05.863857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ff16c505-c510-441a-86dd-b8359b37b64a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:05.869708 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff16c505-c510-441a-86dd-b8359b37b64a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:05.870151 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff16c505-c510-441a-86dd-b8359b37b64a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:05.870911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff16c505-c510-441a-86dd-b8359b37b64a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:05.871340 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff16c505-c510-441a-86dd-b8359b37b64a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:05.993407 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ff16c505-c510-441a-86dd-b8359b37b64a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:06.001196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ff16c505-c510-441a-86dd-b8359b37b64a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.141597 Jan 28 02:04:06.001753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 520/1045] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:05 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:07.018688 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f9ee179f-d826-47eb-9f9d-da13f9c40409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:07.019328 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f9ee179f-d826-47eb-9f9d-da13f9c40409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:07.025277 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f9ee179f-d826-47eb-9f9d-da13f9c40409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.025728 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f9ee179f-d826-47eb-9f9d-da13f9c40409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.026500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f9ee179f-d826-47eb-9f9d-da13f9c40409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.026937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f9ee179f-d826-47eb-9f9d-da13f9c40409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.099032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bd296bcc-2edf-44c7-949c-0d29c7af144e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:07.099653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bd296bcc-2edf-44c7-949c-0d29c7af144e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:07.105580 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd296bcc-2edf-44c7-949c-0d29c7af144e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.106128 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd296bcc-2edf-44c7-949c-0d29c7af144e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.107227 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd296bcc-2edf-44c7-949c-0d29c7af144e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:07.107665 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd296bcc-2edf-44c7-949c-0d29c7af144e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:07.178282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f9ee179f-d826-47eb-9f9d-da13f9c40409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:07.186142 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f9ee179f-d826-47eb-9f9d-da13f9c40409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.170940 Jan 28 02:04:07.186650 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 526/1046] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:07 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:07.241590 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bd296bcc-2edf-44c7-949c-0d29c7af144e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:07.250668 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bd296bcc-2edf-44c7-949c-0d29c7af144e tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1592 microversion: 2.1 time: 0.155262 Jan 28 02:04:07.251235 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 521/1047] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:07 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1592 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:08.203328 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9eceb3e4-d067-4778-953e-ffad784f625c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:08.203953 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9eceb3e4-d067-4778-953e-ffad784f625c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:08.209895 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9eceb3e4-d067-4778-953e-ffad784f625c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.210341 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9eceb3e4-d067-4778-953e-ffad784f625c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.211119 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9eceb3e4-d067-4778-953e-ffad784f625c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:08.211553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9eceb3e4-d067-4778-953e-ffad784f625c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:08.418639 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9eceb3e4-d067-4778-953e-ffad784f625c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:08.426215 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9eceb3e4-d067-4778-953e-ffad784f625c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.227309 Jan 28 02:04:08.426795 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 527/1048] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:08 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:09.249194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-6a3a40dd-8e7e-4490-952f-7a84547f8a57 req-497d60ca-d963-4f8a-a9d9-ab7f32571243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6d5ac-655f-45b3-838b-02216f1bb988", "tag": "f32c519b-1b2d-4daa-aab9-7451f40e2300"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:09.254550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:09.254550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:04:09.263066 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-6a3a40dd-8e7e-4490-952f-7a84547f8a57 req-497d60ca-d963-4f8a-a9d9-ab7f32571243 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:09.263522 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-6a3a40dd-8e7e-4490-952f-7a84547f8a57 req-497d60ca-d963-4f8a-a9d9-ab7f32571243 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:09.275092 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-6a3a40dd-8e7e-4490-952f-7a84547f8a57 req-497d60ca-d963-4f8a-a9d9-ab7f32571243 service nova] Creating event network-changed:f32c519b-1b2d-4daa-aab9-7451f40e2300 for instance 46b6d5ac-655f-45b3-838b-02216f1bb988 on hv-cinder-82497 Jan 28 02:04:09.281823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-6a3a40dd-8e7e-4490-952f-7a84547f8a57 req-497d60ca-d963-4f8a-a9d9-ab7f32571243 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037107 Jan 28 02:04:09.283226 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 522/1049] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:09.442949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7d37a0ec-d3a8-4bb5-b8c9-eb64a4c27323 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:09.443573 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7d37a0ec-d3a8-4bb5-b8c9-eb64a4c27323 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:09.449479 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d37a0ec-d3a8-4bb5-b8c9-eb64a4c27323 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:09.450204 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d37a0ec-d3a8-4bb5-b8c9-eb64a4c27323 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:09.451225 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d37a0ec-d3a8-4bb5-b8c9-eb64a4c27323 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:09.451873 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d37a0ec-d3a8-4bb5-b8c9-eb64a4c27323 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:09.678843 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7d37a0ec-d3a8-4bb5-b8c9-eb64a4c27323 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:09.689967 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7d37a0ec-d3a8-4bb5-b8c9-eb64a4c27323 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.250533 Jan 28 02:04:09.690809 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 528/1050] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:09 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:10.274675 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-35eb9220-9418-40f2-ad63-c686a901c84d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1660361959"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:10.275289 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-35eb9220-9418-40f2-ad63-c686a901c84d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:10.281921 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35eb9220-9418-40f2-ad63-c686a901c84d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.282625 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35eb9220-9418-40f2-ad63-c686a901c84d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.283392 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35eb9220-9418-40f2-ad63-c686a901c84d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.283823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-35eb9220-9418-40f2-ad63-c686a901c84d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.406176 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.network.security_group_api [None req-35eb9220-9418-40f2-ad63-c686a901c84d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Adding security group 07e9ab82-2e26-4332-8813-31205d25f8fd to port f32c519b-1b2d-4daa-aab9-7451f40e2300 Jan 28 02:04:10.710772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7b715e8c-23cf-4589-9e55-1db4c3e60622 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:10.711384 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7b715e8c-23cf-4589-9e55-1db4c3e60622 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:10.718916 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7b715e8c-23cf-4589-9e55-1db4c3e60622 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.719384 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7b715e8c-23cf-4589-9e55-1db4c3e60622 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.720141 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7b715e8c-23cf-4589-9e55-1db4c3e60622 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.720572 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7b715e8c-23cf-4589-9e55-1db4c3e60622 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.764423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-35eb9220-9418-40f2-ad63-c686a901c84d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "POST /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/action" status: 202 len: 0 microversion: 2.1 time: 0.493508 Jan 28 02:04:10.765722 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 523/1051] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:04:10 2022] POST /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:04:10.774295 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b3ef7ec4-cd84-47b3-b418-7385ea0f7736 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:10.774957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b3ef7ec4-cd84-47b3-b418-7385ea0f7736 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:10.781899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3ef7ec4-cd84-47b3-b418-7385ea0f7736 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.782879 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3ef7ec4-cd84-47b3-b418-7385ea0f7736 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.783837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3ef7ec4-cd84-47b3-b418-7385ea0f7736 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:10.784429 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3ef7ec4-cd84-47b3-b418-7385ea0f7736 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:10.972909 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7b715e8c-23cf-4589-9e55-1db4c3e60622 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:10.980615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7b715e8c-23cf-4589-9e55-1db4c3e60622 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1676 microversion: 2.1 time: 0.274273 Jan 28 02:04:10.984061 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b3ef7ec4-cd84-47b3-b418-7385ea0f7736 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:10.987582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 529/1052] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:10 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1676 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:10.994343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b3ef7ec4-cd84-47b3-b418-7385ea0f7736 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1758 microversion: 2.1 time: 0.223616 Jan 28 02:04:10.995719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 524/1053] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:10 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:11.299343 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-3e7cf739-59aa-4113-bf89-f2bd4c1e13e9 req-db74011a-7d97-4879-9917-a6070577d3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6d5ac-655f-45b3-838b-02216f1bb988", "tag": "f32c519b-1b2d-4daa-aab9-7451f40e2300"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:11.300954 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:11.300954 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:04:11.307949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-3e7cf739-59aa-4113-bf89-f2bd4c1e13e9 req-db74011a-7d97-4879-9917-a6070577d3a7 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:11.308506 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-3e7cf739-59aa-4113-bf89-f2bd4c1e13e9 req-db74011a-7d97-4879-9917-a6070577d3a7 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:11.320931 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-3e7cf739-59aa-4113-bf89-f2bd4c1e13e9 req-db74011a-7d97-4879-9917-a6070577d3a7 service nova] Creating event network-changed:f32c519b-1b2d-4daa-aab9-7451f40e2300 for instance 46b6d5ac-655f-45b3-838b-02216f1bb988 on hv-cinder-82497 Jan 28 02:04:11.327699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-3e7cf739-59aa-4113-bf89-f2bd4c1e13e9 req-db74011a-7d97-4879-9917-a6070577d3a7 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033036 Jan 28 02:04:11.328476 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 530/1054] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:12.005668 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9ca261e0-f6f1-4278-9fb2-c6e33e97132d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:12.006365 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9ca261e0-f6f1-4278-9fb2-c6e33e97132d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:12.012403 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ca261e0-f6f1-4278-9fb2-c6e33e97132d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.013126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ca261e0-f6f1-4278-9fb2-c6e33e97132d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.014026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ca261e0-f6f1-4278-9fb2-c6e33e97132d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.014591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ca261e0-f6f1-4278-9fb2-c6e33e97132d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.138200 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9ca261e0-f6f1-4278-9fb2-c6e33e97132d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:12.145241 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9ca261e0-f6f1-4278-9fb2-c6e33e97132d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1653 microversion: 2.1 time: 0.143280 Jan 28 02:04:12.145816 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 525/1055] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:12 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1653 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:12.162168 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e2ed5ff1-86f2-463c-a75e-bd6332a52f56 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:12.169266 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2ed5ff1-86f2-463c-a75e-bd6332a52f56 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.169720 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2ed5ff1-86f2-463c-a75e-bd6332a52f56 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.192149 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e2ed5ff1-86f2-463c-a75e-bd6332a52f56 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Going to try to start instance {{(pid=115798) start /opt/stack/nova/nova/compute/api.py:2675}} Jan 28 02:04:12.234418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e2ed5ff1-86f2-463c-a75e-bd6332a52f56 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action" status: 202 len: 0 microversion: 2.1 time: 0.076054 Jan 28 02:04:12.235077 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 531/1056] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:04:12 2022] POST /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:04:12.243592 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-01fcc530-c04e-4a87-a55e-10e63c01f140 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:12.244329 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-01fcc530-c04e-4a87-a55e-10e63c01f140 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:12.251165 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01fcc530-c04e-4a87-a55e-10e63c01f140 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.251605 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01fcc530-c04e-4a87-a55e-10e63c01f140 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.252374 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01fcc530-c04e-4a87-a55e-10e63c01f140 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:12.252824 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01fcc530-c04e-4a87-a55e-10e63c01f140 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:12.392106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-01fcc530-c04e-4a87-a55e-10e63c01f140 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:12.403505 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-01fcc530-c04e-4a87-a55e-10e63c01f140 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1662 microversion: 2.1 time: 0.163148 Jan 28 02:04:12.404184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 526/1057] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:12 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:13.422258 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6c8d02fd-1590-4345-a261-6c74f4ae04aa tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:13.422949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6c8d02fd-1590-4345-a261-6c74f4ae04aa tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:13.429039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c8d02fd-1590-4345-a261-6c74f4ae04aa tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.429488 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c8d02fd-1590-4345-a261-6c74f4ae04aa tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.430252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c8d02fd-1590-4345-a261-6c74f4ae04aa tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:13.430684 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c8d02fd-1590-4345-a261-6c74f4ae04aa tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:13.558190 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6c8d02fd-1590-4345-a261-6c74f4ae04aa tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:13.567226 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6c8d02fd-1590-4345-a261-6c74f4ae04aa tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1662 microversion: 2.1 time: 0.149105 Jan 28 02:04:13.567805 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 532/1058] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:13 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:14.587458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5085f324-0e45-4e39-9eeb-37d992f2e162 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:14.588065 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5085f324-0e45-4e39-9eeb-37d992f2e162 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:14.594382 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5085f324-0e45-4e39-9eeb-37d992f2e162 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:14.594830 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5085f324-0e45-4e39-9eeb-37d992f2e162 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:14.595609 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5085f324-0e45-4e39-9eeb-37d992f2e162 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:14.596042 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5085f324-0e45-4e39-9eeb-37d992f2e162 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:14.722562 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5085f324-0e45-4e39-9eeb-37d992f2e162 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:14.729992 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5085f324-0e45-4e39-9eeb-37d992f2e162 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1666 microversion: 2.1 time: 0.146128 Jan 28 02:04:14.730566 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 527/1059] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:14 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1666 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:19.598439 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3c7190e3-1b9c-4add-8632-79fc9f52796a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:19.599549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3c7190e3-1b9c-4add-8632-79fc9f52796a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:19.605673 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c7190e3-1b9c-4add-8632-79fc9f52796a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.606154 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c7190e3-1b9c-4add-8632-79fc9f52796a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.607247 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c7190e3-1b9c-4add-8632-79fc9f52796a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.607700 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c7190e3-1b9c-4add-8632-79fc9f52796a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.640716 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3c7190e3-1b9c-4add-8632-79fc9f52796a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046139 Jan 28 02:04:19.641315 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 533/1060] 10.222.0.96 () {60 vars in 1342 bytes} [Fri Jan 28 02:04:19 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:19.701646 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-434f555c-7e0e-4b6c-8c4d-18a07c7de410 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:19.702139 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-434f555c-7e0e-4b6c-8c4d-18a07c7de410 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:19.708489 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-434f555c-7e0e-4b6c-8c4d-18a07c7de410 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.708991 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-434f555c-7e0e-4b6c-8c4d-18a07c7de410 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.709800 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-434f555c-7e0e-4b6c-8c4d-18a07c7de410 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.710234 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-434f555c-7e0e-4b6c-8c4d-18a07c7de410 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.734898 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-434f555c-7e0e-4b6c-8c4d-18a07c7de410 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:19.813031 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-434f555c-7e0e-4b6c-8c4d-18a07c7de410 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "DELETE /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 204 len: 0 microversion: 2.20 time: 0.115230 Jan 28 02:04:19.816485 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 528/1061] 10.222.0.96 () {60 vars in 1279 bytes} [Fri Jan 28 02:04:19 2022] DELETE /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:04:19.821624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:19.822316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:19.828714 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.829199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.829974 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:19.830412 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:19.953086 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:19.960600 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:19.962112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:19.963244 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8a5509fe-d410-4030-8542-da209c2f9450 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.145423 Jan 28 02:04:19.963799 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 534/1062] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:19 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:20.982528 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:20.983210 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:20.991679 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.992124 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:20.992956 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:20.993392 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:21.119628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:21.127400 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:21.128911 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:21.130049 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e9f9436b-fd79-4f5b-8f17-a445b7bbc61a tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.151935 Jan 28 02:04:21.130601 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 529/1063] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:20 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:22.148818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:22.149442 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:22.155321 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:22.155767 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:22.156535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:22.157024 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:22.317274 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:22.325359 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:22.327353 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c34c05b7e55447f2a5ddf9c9b9299f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c744efbffa214f18ab24d619620343c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:22.328515 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-305116b6-6ba6-4cc6-a1a5-f83e9c181a20 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 200 len: 1724 microversion: 2.20 time: 0.183634 Jan 28 02:04:22.329099 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 535/1064] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:22 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:22.649193 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-470e9f57-46a1-4316-9801-169a7bf0fa3b req-67ad8b1a-27f0-4473-acd1-f62c2c220ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e2f5bb-ea79-4637-b7a5-5f4d10aebe58", "name": "network-vif-deleted", "tag": "b3df727d-fb39-47e3-88bf-cdef71b67bf5"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:22.650813 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:22.650813 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:04:22.659448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-470e9f57-46a1-4316-9801-169a7bf0fa3b req-67ad8b1a-27f0-4473-acd1-f62c2c220ebf service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:22.660040 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-470e9f57-46a1-4316-9801-169a7bf0fa3b req-67ad8b1a-27f0-4473-acd1-f62c2c220ebf service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:22.672106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-470e9f57-46a1-4316-9801-169a7bf0fa3b req-67ad8b1a-27f0-4473-acd1-f62c2c220ebf service nova] Creating event network-vif-deleted:b3df727d-fb39-47e3-88bf-cdef71b67bf5 for instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 on hv-cinder-82497 Jan 28 02:04:22.677721 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-470e9f57-46a1-4316-9801-169a7bf0fa3b req-67ad8b1a-27f0-4473-acd1-f62c2c220ebf service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032042 Jan 28 02:04:22.679179 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 530/1065] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:23.347162 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:23.347724 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:23.353481 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:23.353926 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:23.354693 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:23.355122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:23.368608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] HTTP exception thrown: Instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 could not be found. Jan 28 02:04:23.369218 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Returning 404 to user: Instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:23.370039 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-da3e51ed-dd99-4d29-aa2d-1b22902ca285 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 404 len: 111 microversion: 2.20 time: 0.026689 Jan 28 02:04:23.370587 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 536/1066] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:23 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:04:23.379269 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ea465a74-23d9-4ef2-bd02-2c2cde4ad4c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '.version_select at 0x7f523f121940>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:23.398356 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ea465a74-23d9-4ef2-bd02-2c2cde4ad4c5 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009115177" status: 204 len: 0 microversion: 2.20 time: 0.022913 Jan 28 02:04:23.398934 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 531/1067] 10.222.0.96 () {60 vars in 1261 bytes} [Fri Jan 28 02:04:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009115177 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:04:24.267670 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1938527018", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-363378608", "security_groups": [{"name": "tempest-secgroup-smoke-1260954673"}], "block_device_mapping_v2": [{"uuid": "aaf82d28-665f-4294-877e-f3767f8c5270", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41f7abf6-a2c1-4ce5-83fe-68e8627532be"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:24.372522 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] validate_networks() for [('41f7abf6-a2c1-4ce5-83fe-68e8627532be', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:04:24.747641 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:04:24.748076 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:04:24.748557 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:04:24.749015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:04:24.749506 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:04:24.758300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.758754 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.759583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:24.760042 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:24.776920 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for project 6e15e80496d946b4ba64c95751ebc354. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:04:24.783882 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Getting quotas for user cd9cb4ec35524e859b828892c95130e7 and project 6e15e80496d946b4ba64c95751ebc354. Resources: {'instances', 'cores', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:04:24.843670 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:04:24.845848 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aaf82d28-665f-4294-877e-f3767f8c5270',volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:04:24.968699 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-157c9750-a02c-45b6-8a98-01f543fa95b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704672 Jan 28 02:04:24.969401 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 537/1068] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 02:04:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:04:24.979144 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-38c2a348-777b-4dc6-b700-b10d069d65d4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:24.980009 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-38c2a348-777b-4dc6-b700-b10d069d65d4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:25.035675 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-38c2a348-777b-4dc6-b700-b10d069d65d4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:25.041980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-38c2a348-777b-4dc6-b700-b10d069d65d4 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1094 microversion: 2.1 time: 0.066531 Jan 28 02:04:25.042538 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 532/1069] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:24 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:25.195516 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:25.196261 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:25.203448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:25.203901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:25.204679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:25.205158 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:25.218966 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] HTTP exception thrown: Instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 could not be found. Jan 28 02:04:25.219556 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Returning 404 to user: Instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:25.220517 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-96ce456f-d2e8-49a2-91bf-dbaa17fabcd4 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "DELETE /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 404 len: 111 microversion: 2.20 time: 0.028940 Jan 28 02:04:25.221009 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 538/1070] 10.222.0.96 () {60 vars in 1279 bytes} [Fri Jan 28 02:04:25 2022] DELETE /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:04:25.228874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:25.229492 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:25.237548 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:25.238008 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:25.238794 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:25.239237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:25.253181 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] HTTP exception thrown: Instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 could not be found. Jan 28 02:04:25.253781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Returning 404 to user: Instance 23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:25.254617 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-52358299-3ddd-49ea-8d3a-ed2a387d7b17 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58" status: 404 len: 111 microversion: 2.20 time: 0.029512 Jan 28 02:04:25.255165 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 533/1071] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:25 2022] GET /compute/v2.1/servers/23e2f5bb-ea79-4637-b7a5-5f4d10aebe58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:04:26.059553 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fb2bcd33-6c74-45e5-a15d-0b854b6d7952 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:26.060266 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fb2bcd33-6c74-45e5-a15d-0b854b6d7952 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:26.066007 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb2bcd33-6c74-45e5-a15d-0b854b6d7952 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.066372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb2bcd33-6c74-45e5-a15d-0b854b6d7952 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.067152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb2bcd33-6c74-45e5-a15d-0b854b6d7952 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.067595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb2bcd33-6c74-45e5-a15d-0b854b6d7952 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.140970 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fb2bcd33-6c74-45e5-a15d-0b854b6d7952 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:26.148202 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fb2bcd33-6c74-45e5-a15d-0b854b6d7952 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1210 microversion: 2.1 time: 0.092457 Jan 28 02:04:26.148750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 539/1072] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:26 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:26.397980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:26.398547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:26.404855 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.405220 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.406012 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.406476 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.422419 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] HTTP exception thrown: Instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 could not be found. Jan 28 02:04:26.423109 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Returning 404 to user: Instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:26.423963 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-babe2cf7-46a0-4d5a-be4f-41a7c562f690 tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "DELETE /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 404 len: 111 microversion: 2.20 time: 0.029820 Jan 28 02:04:26.424531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 534/1073] 10.222.0.96 () {60 vars in 1279 bytes} [Fri Jan 28 02:04:26 2022] DELETE /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:04:26.432706 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:26.433465 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] [instance: 7a1879ef-ae58-41eb-9c13-3f9a3988a970] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:26.440413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.441012 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.441885 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:26.442395 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:26.457478 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] HTTP exception thrown: Instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 could not be found. Jan 28 02:04:26.458083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] Returning 404 to user: Instance 7a1879ef-ae58-41eb-9c13-3f9a3988a970 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:26.459035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-36f1930b-8d4c-4d42-9834-a0db1e2dbf6c tempest-AttachVolumeShelveTestJSON-1135742798 tempest-AttachVolumeShelveTestJSON-1135742798-project] 10.222.0.96 "GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970" status: 404 len: 111 microversion: 2.20 time: 0.030090 Jan 28 02:04:26.459695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 540/1074] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Jan 28 02:04:26 2022] GET /compute/v2.1/servers/7a1879ef-ae58-41eb-9c13-3f9a3988a970 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:04:27.166318 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0632e4e1-d455-4295-a038-d838229b6e69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:27.166928 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0632e4e1-d455-4295-a038-d838229b6e69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:27.174264 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0632e4e1-d455-4295-a038-d838229b6e69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.174982 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0632e4e1-d455-4295-a038-d838229b6e69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.175956 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0632e4e1-d455-4295-a038-d838229b6e69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.180838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0632e4e1-d455-4295-a038-d838229b6e69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.418396 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0632e4e1-d455-4295-a038-d838229b6e69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:27.426699 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0632e4e1-d455-4295-a038-d838229b6e69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.264071 Jan 28 02:04:27.427405 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 535/1075] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:27 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:27.819491 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-7b77b340-834c-4263-a6b2-28bea4bcef85 req-da91b65e-0d09-49fd-ac89-e16966d35166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c241188c-6827-43b6-87ca-c196237b79d4", "tag": "a1c59218-2656-4158-91d1-b7d7e0447fb0"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:27.830202 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:27.830202 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:04:27.844630 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-7b77b340-834c-4263-a6b2-28bea4bcef85 req-da91b65e-0d09-49fd-ac89-e16966d35166 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:27.845466 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-7b77b340-834c-4263-a6b2-28bea4bcef85 req-da91b65e-0d09-49fd-ac89-e16966d35166 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:27.862067 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-7b77b340-834c-4263-a6b2-28bea4bcef85 req-da91b65e-0d09-49fd-ac89-e16966d35166 service nova] Creating event network-changed:a1c59218-2656-4158-91d1-b7d7e0447fb0 for instance c241188c-6827-43b6-87ca-c196237b79d4 on hv-cinder-82497 Jan 28 02:04:27.867760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-7b77b340-834c-4263-a6b2-28bea4bcef85 req-da91b65e-0d09-49fd-ac89-e16966d35166 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054679 Jan 28 02:04:27.868520 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 541/1076] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:28.455224 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8b771cba-bc2d-484e-8956-b9590056d57b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:28.457026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8b771cba-bc2d-484e-8956-b9590056d57b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:28.463764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8b771cba-bc2d-484e-8956-b9590056d57b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.464501 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8b771cba-bc2d-484e-8956-b9590056d57b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.465328 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8b771cba-bc2d-484e-8956-b9590056d57b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:28.465836 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8b771cba-bc2d-484e-8956-b9590056d57b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:28.776194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8b771cba-bc2d-484e-8956-b9590056d57b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:28.784725 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8b771cba-bc2d-484e-8956-b9590056d57b tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.344682 Jan 28 02:04:28.785343 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 536/1077] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:28 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:29.803229 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7df407d0-fd08-40f9-a39d-e04e1a1ed626 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:29.804224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7df407d0-fd08-40f9-a39d-e04e1a1ed626 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:29.811055 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7df407d0-fd08-40f9-a39d-e04e1a1ed626 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.811458 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7df407d0-fd08-40f9-a39d-e04e1a1ed626 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.812448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7df407d0-fd08-40f9-a39d-e04e1a1ed626 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:29.812835 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7df407d0-fd08-40f9-a39d-e04e1a1ed626 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:29.990908 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7df407d0-fd08-40f9-a39d-e04e1a1ed626 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:29.998773 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7df407d0-fd08-40f9-a39d-e04e1a1ed626 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.199592 Jan 28 02:04:29.999339 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 542/1078] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:29 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:31.015918 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-05ee81a2-f8c1-4b9c-b654-ef8245aca0be tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:31.016591 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-05ee81a2-f8c1-4b9c-b654-ef8245aca0be tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:31.022316 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05ee81a2-f8c1-4b9c-b654-ef8245aca0be tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.022764 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05ee81a2-f8c1-4b9c-b654-ef8245aca0be tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.023546 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05ee81a2-f8c1-4b9c-b654-ef8245aca0be tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:31.023978 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05ee81a2-f8c1-4b9c-b654-ef8245aca0be tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:31.156386 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-05ee81a2-f8c1-4b9c-b654-ef8245aca0be tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:31.164291 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-05ee81a2-f8c1-4b9c-b654-ef8245aca0be tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.152537 Jan 28 02:04:31.165106 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 537/1079] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:31 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:32.182304 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc70adc8-e252-43ca-87f8-ab51162ad1f3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:32.183004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc70adc8-e252-43ca-87f8-ab51162ad1f3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:32.189537 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc70adc8-e252-43ca-87f8-ab51162ad1f3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:32.190065 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc70adc8-e252-43ca-87f8-ab51162ad1f3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:32.190909 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc70adc8-e252-43ca-87f8-ab51162ad1f3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:32.191352 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc70adc8-e252-43ca-87f8-ab51162ad1f3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:32.321066 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bc70adc8-e252-43ca-87f8-ab51162ad1f3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:32.329472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc70adc8-e252-43ca-87f8-ab51162ad1f3 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.150912 Jan 28 02:04:32.330030 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 543/1080] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:32 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:33.346574 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cdc5440f-5eea-438e-9e1b-31b3154ed87c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:33.347196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cdc5440f-5eea-438e-9e1b-31b3154ed87c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:33.352974 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cdc5440f-5eea-438e-9e1b-31b3154ed87c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.353427 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cdc5440f-5eea-438e-9e1b-31b3154ed87c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.354205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cdc5440f-5eea-438e-9e1b-31b3154ed87c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:33.354643 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cdc5440f-5eea-438e-9e1b-31b3154ed87c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:33.485739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cdc5440f-5eea-438e-9e1b-31b3154ed87c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:33.493190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cdc5440f-5eea-438e-9e1b-31b3154ed87c tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.150255 Jan 28 02:04:33.493755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 538/1081] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:33 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:34.515773 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ceb2e06f-d284-46df-a6e1-517c7cc39c69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:34.517051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ceb2e06f-d284-46df-a6e1-517c7cc39c69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:34.525695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ceb2e06f-d284-46df-a6e1-517c7cc39c69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.526147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ceb2e06f-d284-46df-a6e1-517c7cc39c69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.526927 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ceb2e06f-d284-46df-a6e1-517c7cc39c69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:34.527425 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ceb2e06f-d284-46df-a6e1-517c7cc39c69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:34.669955 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ceb2e06f-d284-46df-a6e1-517c7cc39c69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:34.677495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ceb2e06f-d284-46df-a6e1-517c7cc39c69 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.169366 Jan 28 02:04:34.678072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 544/1082] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:34 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:35.694647 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-26392bb1-53ce-4cf4-b636-31be8c6b90f6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:35.695249 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-26392bb1-53ce-4cf4-b636-31be8c6b90f6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:35.701268 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26392bb1-53ce-4cf4-b636-31be8c6b90f6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:35.701717 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26392bb1-53ce-4cf4-b636-31be8c6b90f6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:35.702482 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26392bb1-53ce-4cf4-b636-31be8c6b90f6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:35.702919 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26392bb1-53ce-4cf4-b636-31be8c6b90f6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:35.823597 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-26392bb1-53ce-4cf4-b636-31be8c6b90f6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:35.831360 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-26392bb1-53ce-4cf4-b636-31be8c6b90f6 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.140400 Jan 28 02:04:35.831931 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 539/1083] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:35 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:36.694810 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-224c0d63-8d55-4260-8e43-f1dbc4c448e5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:36.695792 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-224c0d63-8d55-4260-8e43-f1dbc4c448e5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:36.702211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-224c0d63-8d55-4260-8e43-f1dbc4c448e5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.702661 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-224c0d63-8d55-4260-8e43-f1dbc4c448e5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.703428 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-224c0d63-8d55-4260-8e43-f1dbc4c448e5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.703865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-224c0d63-8d55-4260-8e43-f1dbc4c448e5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.775504 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-224c0d63-8d55-4260-8e43-f1dbc4c448e5 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "POST /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/action" status: 202 len: 0 microversion: 2.1 time: 0.084215 Jan 28 02:04:36.779910 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 545/1084] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:04:36 2022] POST /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:04:36.795135 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2a5153f2-8be8-4228-aaa8-0995841c8b74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:36.796077 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2a5153f2-8be8-4228-aaa8-0995841c8b74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:36.802585 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a5153f2-8be8-4228-aaa8-0995841c8b74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.803138 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a5153f2-8be8-4228-aaa8-0995841c8b74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.804056 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a5153f2-8be8-4228-aaa8-0995841c8b74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.804515 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a5153f2-8be8-4228-aaa8-0995841c8b74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.848346 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cecf7eda-9aa7-4513-b1ce-114d48d8ef5a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:36.849105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cecf7eda-9aa7-4513-b1ce-114d48d8ef5a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:36.855247 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cecf7eda-9aa7-4513-b1ce-114d48d8ef5a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.855812 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cecf7eda-9aa7-4513-b1ce-114d48d8ef5a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:36.857002 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cecf7eda-9aa7-4513-b1ce-114d48d8ef5a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:36.857643 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cecf7eda-9aa7-4513-b1ce-114d48d8ef5a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:37.011652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2a5153f2-8be8-4228-aaa8-0995841c8b74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:37.019372 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2a5153f2-8be8-4228-aaa8-0995841c8b74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1750 microversion: 2.1 time: 0.238191 Jan 28 02:04:37.019939 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 540/1085] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:36 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1750 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:37.089742 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cecf7eda-9aa7-4513-b1ce-114d48d8ef5a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:37.098311 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cecf7eda-9aa7-4513-b1ce-114d48d8ef5a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.253912 Jan 28 02:04:37.098992 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 546/1086] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:36 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:38.039237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-81d8ea47-ecd6-44b4-92ab-099e5967e4aa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:38.040458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-81d8ea47-ecd6-44b4-92ab-099e5967e4aa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:38.047843 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81d8ea47-ecd6-44b4-92ab-099e5967e4aa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.048414 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81d8ea47-ecd6-44b4-92ab-099e5967e4aa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.049706 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81d8ea47-ecd6-44b4-92ab-099e5967e4aa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.050450 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81d8ea47-ecd6-44b4-92ab-099e5967e4aa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.118986 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3d4e7709-e48c-4771-80e0-2d50da5f04ff tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:38.120455 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3d4e7709-e48c-4771-80e0-2d50da5f04ff tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:38.127694 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d4e7709-e48c-4771-80e0-2d50da5f04ff tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.129946 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d4e7709-e48c-4771-80e0-2d50da5f04ff tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.130948 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d4e7709-e48c-4771-80e0-2d50da5f04ff tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:38.139143 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d4e7709-e48c-4771-80e0-2d50da5f04ff tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:38.228469 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-81d8ea47-ecd6-44b4-92ab-099e5967e4aa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:38.238655 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-81d8ea47-ecd6-44b4-92ab-099e5967e4aa tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.204331 Jan 28 02:04:38.242068 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 541/1087] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:38 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:38.311194 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3d4e7709-e48c-4771-80e0-2d50da5f04ff tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:38.318771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3d4e7709-e48c-4771-80e0-2d50da5f04ff tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.206927 Jan 28 02:04:38.319340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 547/1088] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:38 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:39.259256 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fe78357f-36c1-4995-9343-963c614c2b5f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:39.260483 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fe78357f-36c1-4995-9343-963c614c2b5f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:39.267350 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe78357f-36c1-4995-9343-963c614c2b5f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.267800 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe78357f-36c1-4995-9343-963c614c2b5f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.268743 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe78357f-36c1-4995-9343-963c614c2b5f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.269196 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe78357f-36c1-4995-9343-963c614c2b5f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.335959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8af15f9a-b5e4-4a17-bec4-af2a4d7c3503 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:39.336730 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8af15f9a-b5e4-4a17-bec4-af2a4d7c3503 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:39.343112 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8af15f9a-b5e4-4a17-bec4-af2a4d7c3503 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.343561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8af15f9a-b5e4-4a17-bec4-af2a4d7c3503 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.344341 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8af15f9a-b5e4-4a17-bec4-af2a4d7c3503 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.344772 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8af15f9a-b5e4-4a17-bec4-af2a4d7c3503 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.499355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fe78357f-36c1-4995-9343-963c614c2b5f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:39.508004 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fe78357f-36c1-4995-9343-963c614c2b5f tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.252691 Jan 28 02:04:39.508539 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 542/1089] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:39 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:39.578355 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-052c9f7d-1299-4001-a4d2-cf5d5ebc64dc req-3f03f3f7-7938-409f-8ea8-1af0673e5aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c241188c-6827-43b6-87ca-c196237b79d4", "name": "network-vif-plugged", "status": "completed", "tag": "a1c59218-2656-4158-91d1-b7d7e0447fb0"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:39.580606 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:39.580606 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:04:39.589132 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-052c9f7d-1299-4001-a4d2-cf5d5ebc64dc req-3f03f3f7-7938-409f-8ea8-1af0673e5aac service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:39.589603 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-052c9f7d-1299-4001-a4d2-cf5d5ebc64dc req-3f03f3f7-7938-409f-8ea8-1af0673e5aac service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:39.603550 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-052c9f7d-1299-4001-a4d2-cf5d5ebc64dc req-3f03f3f7-7938-409f-8ea8-1af0673e5aac service nova] Creating event network-vif-plugged:a1c59218-2656-4158-91d1-b7d7e0447fb0 for instance c241188c-6827-43b6-87ca-c196237b79d4 on hv-cinder-82497 Jan 28 02:04:39.612977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-052c9f7d-1299-4001-a4d2-cf5d5ebc64dc req-3f03f3f7-7938-409f-8ea8-1af0673e5aac service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039472 Jan 28 02:04:39.613774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 543/1090] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:04:39.824274 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8af15f9a-b5e4-4a17-bec4-af2a4d7c3503 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:39.834130 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8af15f9a-b5e4-4a17-bec4-af2a4d7c3503 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.501762 Jan 28 02:04:39.834711 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 548/1091] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:39 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:40.527193 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6d81c1db-1582-4064-b421-c20a5aa6b1dc tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:40.528882 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6d81c1db-1582-4064-b421-c20a5aa6b1dc tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:40.535653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d81c1db-1582-4064-b421-c20a5aa6b1dc tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.536197 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d81c1db-1582-4064-b421-c20a5aa6b1dc tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.537081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d81c1db-1582-4064-b421-c20a5aa6b1dc tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.537610 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d81c1db-1582-4064-b421-c20a5aa6b1dc tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.677679 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6d81c1db-1582-4064-b421-c20a5aa6b1dc tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:40.686856 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6d81c1db-1582-4064-b421-c20a5aa6b1dc tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.164258 Jan 28 02:04:40.687438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 544/1092] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:40 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:40.851623 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-689abe50-655f-484c-a67d-0d3e7917afa9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:40.852346 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-689abe50-655f-484c-a67d-0d3e7917afa9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:40.859544 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-689abe50-655f-484c-a67d-0d3e7917afa9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.860063 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-689abe50-655f-484c-a67d-0d3e7917afa9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:40.860921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-689abe50-655f-484c-a67d-0d3e7917afa9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:40.861614 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-689abe50-655f-484c-a67d-0d3e7917afa9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.027529 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-689abe50-655f-484c-a67d-0d3e7917afa9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:41.037778 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-689abe50-655f-484c-a67d-0d3e7917afa9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1266 microversion: 2.1 time: 0.190166 Jan 28 02:04:41.038541 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 549/1093] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:40 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:41.704374 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6722aa41-8c92-4d09-8f8a-d7e5a1880b99 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:41.705069 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6722aa41-8c92-4d09-8f8a-d7e5a1880b99 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:41.710908 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6722aa41-8c92-4d09-8f8a-d7e5a1880b99 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:41.711361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6722aa41-8c92-4d09-8f8a-d7e5a1880b99 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.712126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6722aa41-8c92-4d09-8f8a-d7e5a1880b99 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:41.712569 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6722aa41-8c92-4d09-8f8a-d7e5a1880b99 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:41.933268 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6722aa41-8c92-4d09-8f8a-d7e5a1880b99 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:41.943247 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6722aa41-8c92-4d09-8f8a-d7e5a1880b99 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.242302 Jan 28 02:04:41.944024 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 545/1094] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:41 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:42.062599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3477d9f3-33fe-4440-9588-15f0350ff18a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:42.063361 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3477d9f3-33fe-4440-9588-15f0350ff18a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:42.069287 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3477d9f3-33fe-4440-9588-15f0350ff18a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.069815 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3477d9f3-33fe-4440-9588-15f0350ff18a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.070667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3477d9f3-33fe-4440-9588-15f0350ff18a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.071204 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3477d9f3-33fe-4440-9588-15f0350ff18a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.206865 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3477d9f3-33fe-4440-9588-15f0350ff18a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:42.229791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3477d9f3-33fe-4440-9588-15f0350ff18a tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1453 microversion: 2.1 time: 0.170763 Jan 28 02:04:42.230747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 550/1095] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:42 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:42.246163 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-25f7dd41-8b12-4b44-93a2-e6f7604f8e1d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:42.247338 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-25f7dd41-8b12-4b44-93a2-e6f7604f8e1d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:42.253130 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-25f7dd41-8b12-4b44-93a2-e6f7604f8e1d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.253584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-25f7dd41-8b12-4b44-93a2-e6f7604f8e1d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.254358 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-25f7dd41-8b12-4b44-93a2-e6f7604f8e1d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.254791 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-25f7dd41-8b12-4b44-93a2-e6f7604f8e1d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.387362 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-25f7dd41-8b12-4b44-93a2-e6f7604f8e1d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:42.395221 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-25f7dd41-8b12-4b44-93a2-e6f7604f8e1d tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1453 microversion: 2.1 time: 0.152743 Jan 28 02:04:42.396168 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 546/1096] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:42 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:42.941154 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-ea9c02f7-b076-4ee2-94c0-f32e417ca80d req-b427e680-f6b4-4222-a42f-eaa43add8614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a298e144-76c9-46a8-9fd3-10930cffe935", "tag": "1938f369-8c3b-46ca-90e4-040b0e1f5517"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:42.942495 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3cdb7aab-8bfa-4f58-89e2-fcc9d4ac0452 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:42.947823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:42.947823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:04:42.948441 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3cdb7aab-8bfa-4f58-89e2-fcc9d4ac0452 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:42.970659 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ea9c02f7-b076-4ee2-94c0-f32e417ca80d req-b427e680-f6b4-4222-a42f-eaa43add8614 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.971325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3cdb7aab-8bfa-4f58-89e2-fcc9d4ac0452 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.971957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3cdb7aab-8bfa-4f58-89e2-fcc9d4ac0452 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.973105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3cdb7aab-8bfa-4f58-89e2-fcc9d4ac0452 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:42.973695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3cdb7aab-8bfa-4f58-89e2-fcc9d4ac0452 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:42.974331 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ea9c02f7-b076-4ee2-94c0-f32e417ca80d req-b427e680-f6b4-4222-a42f-eaa43add8614 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:43.006958 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-ea9c02f7-b076-4ee2-94c0-f32e417ca80d req-b427e680-f6b4-4222-a42f-eaa43add8614 service nova] Creating event network-changed:1938f369-8c3b-46ca-90e4-040b0e1f5517 for instance a298e144-76c9-46a8-9fd3-10930cffe935 on hv-cinder-82497 Jan 28 02:04:43.014674 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-ea9c02f7-b076-4ee2-94c0-f32e417ca80d req-b427e680-f6b4-4222-a42f-eaa43add8614 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077700 Jan 28 02:04:43.016974 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 547/1097] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:04:43.025979 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-90cb6ac3-0cd6-43f9-9a7a-27fabfe8f638 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:43.029987 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-90cb6ac3-0cd6-43f9-9a7a-27fabfe8f638 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:43.038174 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3cdb7aab-8bfa-4f58-89e2-fcc9d4ac0452 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:43.044520 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90cb6ac3-0cd6-43f9-9a7a-27fabfe8f638 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:43.045193 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90cb6ac3-0cd6-43f9-9a7a-27fabfe8f638 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:43.046532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90cb6ac3-0cd6-43f9-9a7a-27fabfe8f638 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:43.047164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90cb6ac3-0cd6-43f9-9a7a-27fabfe8f638 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:43.176172 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3cdb7aab-8bfa-4f58-89e2-fcc9d4ac0452 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "DELETE /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 204 len: 0 microversion: 2.1 time: 0.246302 Jan 28 02:04:43.180954 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 551/1098] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:04:42 2022] DELETE /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:04:43.193624 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d8133bf4-37df-401a-99d8-3800ab0d9cd4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:43.194997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d8133bf4-37df-401a-99d8-3800ab0d9cd4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:43.202418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8133bf4-37df-401a-99d8-3800ab0d9cd4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:43.202977 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8133bf4-37df-401a-99d8-3800ab0d9cd4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:43.203774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8133bf4-37df-401a-99d8-3800ab0d9cd4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:43.204383 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8133bf4-37df-401a-99d8-3800ab0d9cd4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:43.443969 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-90cb6ac3-0cd6-43f9-9a7a-27fabfe8f638 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:43.454981 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-90cb6ac3-0cd6-43f9-9a7a-27fabfe8f638 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.436430 Jan 28 02:04:43.464340 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 548/1099] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:43 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:43.704554 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d8133bf4-37df-401a-99d8-3800ab0d9cd4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:43.712218 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d8133bf4-37df-401a-99d8-3800ab0d9cd4 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1566 microversion: 2.1 time: 0.526318 Jan 28 02:04:43.712788 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 552/1100] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:43 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1566 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:44.473166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-60fca137-16dd-4141-8760-b8ad6f24e7c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:44.473945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-60fca137-16dd-4141-8760-b8ad6f24e7c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:44.479940 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60fca137-16dd-4141-8760-b8ad6f24e7c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.480416 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60fca137-16dd-4141-8760-b8ad6f24e7c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.481440 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60fca137-16dd-4141-8760-b8ad6f24e7c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.481946 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60fca137-16dd-4141-8760-b8ad6f24e7c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.733384 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-60fca137-16dd-4141-8760-b8ad6f24e7c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:44.735893 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-df26441f-1fb1-4ba0-8e51-f311ac629656 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:44.737242 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-df26441f-1fb1-4ba0-8e51-f311ac629656 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:44.741719 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-60fca137-16dd-4141-8760-b8ad6f24e7c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.273182 Jan 28 02:04:44.745114 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-df26441f-1fb1-4ba0-8e51-f311ac629656 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.745825 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-df26441f-1fb1-4ba0-8e51-f311ac629656 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.746615 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-df26441f-1fb1-4ba0-8e51-f311ac629656 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:44.747906 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-df26441f-1fb1-4ba0-8e51-f311ac629656 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:44.752517 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 549/1101] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:44 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:44.971356 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-df26441f-1fb1-4ba0-8e51-f311ac629656 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:44.979438 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-df26441f-1fb1-4ba0-8e51-f311ac629656 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1448 microversion: 2.1 time: 0.251457 Jan 28 02:04:44.980015 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 553/1102] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:44 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1448 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:45.457397 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-d755c04d-7679-42b4-996f-54f592095717 req-64e69f52-9a4e-4a12-94f2-336cf6480499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c241188c-6827-43b6-87ca-c196237b79d4", "tag": "a1c59218-2656-4158-91d1-b7d7e0447fb0"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:45.458844 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:45.458844 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:04:45.467364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-d755c04d-7679-42b4-996f-54f592095717 req-64e69f52-9a4e-4a12-94f2-336cf6480499 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.468144 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-d755c04d-7679-42b4-996f-54f592095717 req-64e69f52-9a4e-4a12-94f2-336cf6480499 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.482033 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-d755c04d-7679-42b4-996f-54f592095717 req-64e69f52-9a4e-4a12-94f2-336cf6480499 service nova] Creating event network-changed:a1c59218-2656-4158-91d1-b7d7e0447fb0 for instance c241188c-6827-43b6-87ca-c196237b79d4 on hv-cinder-82497 Jan 28 02:04:45.487620 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-d755c04d-7679-42b4-996f-54f592095717 req-64e69f52-9a4e-4a12-94f2-336cf6480499 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035621 Jan 28 02:04:45.488884 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 550/1103] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:45.759787 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-943c0a71-feb3-4cfc-a098-a4b32617ae41 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:45.760394 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-943c0a71-feb3-4cfc-a098-a4b32617ae41 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:45.769526 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-943c0a71-feb3-4cfc-a098-a4b32617ae41 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.770236 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-943c0a71-feb3-4cfc-a098-a4b32617ae41 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.771291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-943c0a71-feb3-4cfc-a098-a4b32617ae41 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:45.780327 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-943c0a71-feb3-4cfc-a098-a4b32617ae41 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:45.998413 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9b7aafa6-a509-4211-a8b3-c6ebfee03e04 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:45.999164 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9b7aafa6-a509-4211-a8b3-c6ebfee03e04 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:46.007823 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b7aafa6-a509-4211-a8b3-c6ebfee03e04 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:46.008166 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b7aafa6-a509-4211-a8b3-c6ebfee03e04 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:46.008978 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b7aafa6-a509-4211-a8b3-c6ebfee03e04 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:46.009598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b7aafa6-a509-4211-a8b3-c6ebfee03e04 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:46.015122 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7d371f06-7407-4c62-bbad-ab2c3d804a82] AMQP server on 10.222.0.96:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 28 02:04:46.180480 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-943c0a71-feb3-4cfc-a098-a4b32617ae41 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:46.189739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-943c0a71-feb3-4cfc-a098-a4b32617ae41 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.433638 Jan 28 02:04:46.190418 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 554/1104] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:45 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:46.359496 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9b7aafa6-a509-4211-a8b3-c6ebfee03e04 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:46.375309 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9b7aafa6-a509-4211-a8b3-c6ebfee03e04 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1448 microversion: 2.1 time: 0.381492 Jan 28 02:04:46.394266 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 551/1105] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:45 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1448 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:47.206895 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-87d31be6-ad9b-4bb6-a7c5-b52bb40fda7a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:47.207442 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-87d31be6-ad9b-4bb6-a7c5-b52bb40fda7a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:47.215271 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-87d31be6-ad9b-4bb6-a7c5-b52bb40fda7a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.215718 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-87d31be6-ad9b-4bb6-a7c5-b52bb40fda7a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.216491 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-87d31be6-ad9b-4bb6-a7c5-b52bb40fda7a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.216966 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-87d31be6-ad9b-4bb6-a7c5-b52bb40fda7a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.232309 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] [7d371f06-7407-4c62-bbad-ab2c3d804a82] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 45432. Jan 28 02:04:47.346431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-87d31be6-ad9b-4bb6-a7c5-b52bb40fda7a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:47.354276 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-87d31be6-ad9b-4bb6-a7c5-b52bb40fda7a tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.151166 Jan 28 02:04:47.354939 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 555/1106] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:47 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:47.401422 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:47.402547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:47.408546 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.409026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.409812 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.410244 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.444065 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.444567 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.445173 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lazy-loading 'fault' on Instance uuid a298e144-76c9-46a8-9fd3-10930cffe935 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:04:47.486898 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a315151d7ab945cbbbe4c88adc4b7203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b9208765264efbb2e25f5ba4896b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:47.495527 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-30fcaf21-99ea-4d09-99f4-5da569bfaa48 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 200 len: 1224 microversion: 2.1 time: 0.097728 Jan 28 02:04:47.496102 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 552/1107] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:47 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:47.507000 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-a9efa935-7938-43b3-8659-1cb2b45bdc12 req-afda5c34-50be-4962-98b0-29560ab61e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a298e144-76c9-46a8-9fd3-10930cffe935", "name": "network-vif-deleted", "tag": "1938f369-8c3b-46ca-90e4-040b0e1f5517"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:47.509105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:47.509105 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:04:47.516783 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-a9efa935-7938-43b3-8659-1cb2b45bdc12 req-afda5c34-50be-4962-98b0-29560ab61e22 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:47.517260 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-a9efa935-7938-43b3-8659-1cb2b45bdc12 req-afda5c34-50be-4962-98b0-29560ab61e22 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:47.530152 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-a9efa935-7938-43b3-8659-1cb2b45bdc12 req-afda5c34-50be-4962-98b0-29560ab61e22 service nova] Creating event network-vif-deleted:1938f369-8c3b-46ca-90e4-040b0e1f5517 for instance a298e144-76c9-46a8-9fd3-10930cffe935 on hv-cinder-82497 Jan 28 02:04:47.538267 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-a9efa935-7938-43b3-8659-1cb2b45bdc12 req-afda5c34-50be-4962-98b0-29560ab61e22 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034738 Jan 28 02:04:47.539200 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 556/1108] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:48.371115 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fe5b892c-a236-48d7-a278-3f078e492256 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:48.372297 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fe5b892c-a236-48d7-a278-3f078e492256 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:48.378167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe5b892c-a236-48d7-a278-3f078e492256 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.378612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe5b892c-a236-48d7-a278-3f078e492256 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.379380 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe5b892c-a236-48d7-a278-3f078e492256 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.379812 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe5b892c-a236-48d7-a278-3f078e492256 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.511779 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fe5b892c-a236-48d7-a278-3f078e492256 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:48.514651 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:48.515456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] [instance: a298e144-76c9-46a8-9fd3-10930cffe935] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:48.520980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fe5b892c-a236-48d7-a278-3f078e492256 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.153356 Jan 28 02:04:48.521942 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 553/1109] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:48 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:48.522176 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.523058 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.524065 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:48.524595 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:48.538986 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] HTTP exception thrown: Instance a298e144-76c9-46a8-9fd3-10930cffe935 could not be found. Jan 28 02:04:48.539822 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Returning 404 to user: Instance a298e144-76c9-46a8-9fd3-10930cffe935 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:04:48.540951 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ce400e54-69d9-4462-b73a-bbfff78e1908 tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935" status: 404 len: 111 microversion: 2.1 time: 0.031609 Jan 28 02:04:48.541890 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 557/1110] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:48 2022] GET /compute/v2.1/servers/a298e144-76c9-46a8-9fd3-10930cffe935 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:04:48.728378 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-816b80dc-7d4d-4f75-957b-b681531659bf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] Calling method '.version_select at 0x7f523f204820>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:48.749847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-816b80dc-7d4d-4f75-957b-b681531659bf tempest-TestShelveInstance-478928230 tempest-TestShelveInstance-478928230-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-408487327" status: 202 len: 0 microversion: 2.1 time: 0.025636 Jan 28 02:04:48.750462 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 554/1111] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Jan 28 02:04:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-408487327 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:04:49.539590 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3b32f74e-ac95-43de-98b7-c1ad4839205d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:49.540499 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3b32f74e-ac95-43de-98b7-c1ad4839205d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:49.563401 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b32f74e-ac95-43de-98b7-c1ad4839205d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:49.563950 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b32f74e-ac95-43de-98b7-c1ad4839205d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:49.565036 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b32f74e-ac95-43de-98b7-c1ad4839205d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:49.565667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b32f74e-ac95-43de-98b7-c1ad4839205d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:49.733922 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3b32f74e-ac95-43de-98b7-c1ad4839205d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:49.742135 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3b32f74e-ac95-43de-98b7-c1ad4839205d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.206825 Jan 28 02:04:49.742705 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 558/1112] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:49 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:50.759490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0aa622e5-5e6b-4c68-970a-34da5a492b86 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:50.760255 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0aa622e5-5e6b-4c68-970a-34da5a492b86 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:50.772285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0aa622e5-5e6b-4c68-970a-34da5a492b86 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:50.773481 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0aa622e5-5e6b-4c68-970a-34da5a492b86 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:50.775185 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0aa622e5-5e6b-4c68-970a-34da5a492b86 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:50.775775 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0aa622e5-5e6b-4c68-970a-34da5a492b86 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:50.944144 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0aa622e5-5e6b-4c68-970a-34da5a492b86 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:50.954774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0aa622e5-5e6b-4c68-970a-34da5a492b86 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.198963 Jan 28 02:04:50.955612 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 555/1113] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:50 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:51.972221 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e131621f-006f-4f51-a838-e05588f5605c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:51.972871 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e131621f-006f-4f51-a838-e05588f5605c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:51.982116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e131621f-006f-4f51-a838-e05588f5605c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:51.982116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e131621f-006f-4f51-a838-e05588f5605c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:51.982116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e131621f-006f-4f51-a838-e05588f5605c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:51.982116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e131621f-006f-4f51-a838-e05588f5605c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:52.197424 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e131621f-006f-4f51-a838-e05588f5605c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:52.206744 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e131621f-006f-4f51-a838-e05588f5605c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.238243 Jan 28 02:04:52.207417 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 559/1114] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:51 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:53.224032 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-94629d66-5472-48a9-9752-dba6788ad87d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:53.224782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-94629d66-5472-48a9-9752-dba6788ad87d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:53.230806 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94629d66-5472-48a9-9752-dba6788ad87d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:53.231459 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94629d66-5472-48a9-9752-dba6788ad87d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:53.232597 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94629d66-5472-48a9-9752-dba6788ad87d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:53.233069 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94629d66-5472-48a9-9752-dba6788ad87d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:53.390428 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-94629d66-5472-48a9-9752-dba6788ad87d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:53.400406 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-94629d66-5472-48a9-9752-dba6788ad87d tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1755 microversion: 2.1 time: 0.180418 Jan 28 02:04:53.401194 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 556/1115] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:53 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:53.961959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3e1706fa-fae8-4269-828b-65957b71bac3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:53.963680 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3e1706fa-fae8-4269-828b-65957b71bac3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:53.972106 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e1706fa-fae8-4269-828b-65957b71bac3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:53.972763 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e1706fa-fae8-4269-828b-65957b71bac3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:53.973678 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e1706fa-fae8-4269-828b-65957b71bac3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:53.974102 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e1706fa-fae8-4269-828b-65957b71bac3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.008224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3e1706fa-fae8-4269-828b-65957b71bac3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051123 Jan 28 02:04:54.009182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 560/1116] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:04:53 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:04:54.077021 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d56ad1c8-b763-4e9a-981c-002ff5a4e560 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:54.077522 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d56ad1c8-b763-4e9a-981c-002ff5a4e560 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:54.083774 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d56ad1c8-b763-4e9a-981c-002ff5a4e560 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.084271 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d56ad1c8-b763-4e9a-981c-002ff5a4e560 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.085213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d56ad1c8-b763-4e9a-981c-002ff5a4e560 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.085734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d56ad1c8-b763-4e9a-981c-002ff5a4e560 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.119243 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d56ad1c8-b763-4e9a-981c-002ff5a4e560 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:04:54.221896 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d56ad1c8-b763-4e9a-981c-002ff5a4e560 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 204 len: 0 microversion: 2.1 time: 0.147620 Jan 28 02:04:54.223167 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 557/1117] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:04:54 2022] DELETE /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:04:54.231750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d5cbdcdf-87bd-4ceb-a078-8fe7c26f939e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:54.233477 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d5cbdcdf-87bd-4ceb-a078-8fe7c26f939e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:54.242974 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5cbdcdf-87bd-4ceb-a078-8fe7c26f939e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.243739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5cbdcdf-87bd-4ceb-a078-8fe7c26f939e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.244750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5cbdcdf-87bd-4ceb-a078-8fe7c26f939e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.245264 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d5cbdcdf-87bd-4ceb-a078-8fe7c26f939e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.400902 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d5cbdcdf-87bd-4ceb-a078-8fe7c26f939e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:54.410252 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d5cbdcdf-87bd-4ceb-a078-8fe7c26f939e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1672 microversion: 2.1 time: 0.182908 Jan 28 02:04:54.410824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 561/1118] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:54 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:54.421018 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-55aef1e8-a971-4f75-90ea-b321f438f016 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:54.421018 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-55aef1e8-a971-4f75-90ea-b321f438f016 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:54.426226 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-55aef1e8-a971-4f75-90ea-b321f438f016 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.426750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-55aef1e8-a971-4f75-90ea-b321f438f016 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.427592 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-55aef1e8-a971-4f75-90ea-b321f438f016 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:54.428096 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-55aef1e8-a971-4f75-90ea-b321f438f016 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:54.586334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-55aef1e8-a971-4f75-90ea-b321f438f016 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:54.595383 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-55aef1e8-a971-4f75-90ea-b321f438f016 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1758 microversion: 2.1 time: 0.180388 Jan 28 02:04:54.595977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 558/1119] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:54 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:04:55.428399 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc9ee8ea-4bc2-4cd5-8c2c-9e1866bf65d3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:55.429117 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc9ee8ea-4bc2-4cd5-8c2c-9e1866bf65d3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:55.434828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc9ee8ea-4bc2-4cd5-8c2c-9e1866bf65d3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:55.435276 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc9ee8ea-4bc2-4cd5-8c2c-9e1866bf65d3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:55.436051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc9ee8ea-4bc2-4cd5-8c2c-9e1866bf65d3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:55.436483 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc9ee8ea-4bc2-4cd5-8c2c-9e1866bf65d3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:55.641601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bc9ee8ea-4bc2-4cd5-8c2c-9e1866bf65d3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:55.651844 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc9ee8ea-4bc2-4cd5-8c2c-9e1866bf65d3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1672 microversion: 2.1 time: 0.227035 Jan 28 02:04:55.654021 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 562/1120] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:55 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1672 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:56.670868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f64b7147-66d4-4285-8b63-0d0595daaef4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:56.671861 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f64b7147-66d4-4285-8b63-0d0595daaef4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:56.677359 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f64b7147-66d4-4285-8b63-0d0595daaef4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.677805 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f64b7147-66d4-4285-8b63-0d0595daaef4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.678577 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f64b7147-66d4-4285-8b63-0d0595daaef4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:56.679008 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f64b7147-66d4-4285-8b63-0d0595daaef4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:56.904855 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f64b7147-66d4-4285-8b63-0d0595daaef4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:56.913481 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f64b7147-66d4-4285-8b63-0d0595daaef4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1672 microversion: 2.1 time: 0.246731 Jan 28 02:04:56.914481 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 559/1121] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:56 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:57.930824 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b87c7240-3f9c-47b3-b9af-87c1e3b9f8c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:57.931522 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b87c7240-3f9c-47b3-b9af-87c1e3b9f8c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:57.938338 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b87c7240-3f9c-47b3-b9af-87c1e3b9f8c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:57.938779 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b87c7240-3f9c-47b3-b9af-87c1e3b9f8c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:57.939549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b87c7240-3f9c-47b3-b9af-87c1e3b9f8c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:57.939975 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b87c7240-3f9c-47b3-b9af-87c1e3b9f8c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:58.193001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b87c7240-3f9c-47b3-b9af-87c1e3b9f8c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:58.201401 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b87c7240-3f9c-47b3-b9af-87c1e3b9f8c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1672 microversion: 2.1 time: 0.274157 Jan 28 02:04:58.201964 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 563/1122] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:57 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1672 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:04:58.858853 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-1e81af6e-225f-4007-868b-e671556d3d93 req-b659da90-730d-4cd3-8b7e-5153a7a188fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3", "name": "network-vif-deleted", "tag": "29b6b39c-b993-4f94-9cd1-2d095d6ea243"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:04:58.860466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:58.860466 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:04:58.868960 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-1e81af6e-225f-4007-868b-e671556d3d93 req-b659da90-730d-4cd3-8b7e-5153a7a188fa service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:58.869771 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-1e81af6e-225f-4007-868b-e671556d3d93 req-b659da90-730d-4cd3-8b7e-5153a7a188fa service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:58.881982 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-1e81af6e-225f-4007-868b-e671556d3d93 req-b659da90-730d-4cd3-8b7e-5153a7a188fa service nova] Creating event network-vif-deleted:29b6b39c-b993-4f94-9cd1-2d095d6ea243 for instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 on hv-cinder-82497 Jan 28 02:04:58.888184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-1e81af6e-225f-4007-868b-e671556d3d93 req-b659da90-730d-4cd3-8b7e-5153a7a188fa service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033484 Jan 28 02:04:58.889075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 560/1123] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:59.219802 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-60073d0a-16e4-45a9-a0c6-9f4be60db526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:59.220602 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-60073d0a-16e4-45a9-a0c6-9f4be60db526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:04:59.226568 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60073d0a-16e4-45a9-a0c6-9f4be60db526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:59.227195 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60073d0a-16e4-45a9-a0c6-9f4be60db526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:59.228233 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60073d0a-16e4-45a9-a0c6-9f4be60db526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:59.228549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-60073d0a-16e4-45a9-a0c6-9f4be60db526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:59.292774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-60073d0a-16e4-45a9-a0c6-9f4be60db526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:04:59.301073 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-60073d0a-16e4-45a9-a0c6-9f4be60db526 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1605 microversion: 2.1 time: 0.085389 Jan 28 02:04:59.301793 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 564/1124] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:04:59 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1605 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:00.319976 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:00.320789 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:00.327815 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:00.328260 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:00.329059 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:00.329492 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:00.363252 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:00.364081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:00.364532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lazy-loading 'fault' on Instance uuid b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:05:00.410322 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:00.417172 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-64f70191-6a7d-4406-ac3a-f185833c189b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 200 len: 1326 microversion: 2.1 time: 0.101517 Jan 28 02:05:00.417749 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 561/1125] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:00 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:05:01.435182 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:01.435811 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:01.442403 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:01.442853 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:01.443632 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:01.444061 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:01.459465 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] HTTP exception thrown: Instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 could not be found. Jan 28 02:05:01.460063 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Returning 404 to user: Instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:01.460959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5ad719b0-8705-48ea-8d8b-5bca6275ac77 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 404 len: 111 microversion: 2.1 time: 0.030146 Jan 28 02:05:01.461534 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 565/1126] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:01 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:01.470903 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9250af38-ec07-4e8b-9751-8416e49e3676 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '.version_select at 0x7f523f171a60>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:01.489667 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9250af38-ec07-4e8b-9751-8416e49e3676 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408111758" status: 202 len: 0 microversion: 2.1 time: 0.023076 Jan 28 02:05:01.490258 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 562/1127] 10.222.0.96 () {58 vars in 1217 bytes} [Fri Jan 28 02:05:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408111758 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:05:02.156758 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dc378ee2-3e10-410e-bb41-693314a38797 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'create', calling method: .version_select at 0x7f523f29e0d0>, body: {"keypair": {"name": "tempest-keypair-1011285764"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:02.174842 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-dc378ee2-3e10-410e-bb41-693314a38797 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for project a20883c8bb00403490e966953c48afa7. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:05:02.178562 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-dc378ee2-3e10-410e-bb41-693314a38797 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for user cb4b6e4c21f34cbd8d89686ce74fe07a and project a20883c8bb00403490e966953c48afa7. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:05:02.478040 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-dc378ee2-3e10-410e-bb41-693314a38797 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for project a20883c8bb00403490e966953c48afa7. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:05:02.482123 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-dc378ee2-3e10-410e-bb41-693314a38797 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for user cb4b6e4c21f34cbd8d89686ce74fe07a and project a20883c8bb00403490e966953c48afa7. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:05:02.494407 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dc378ee2-3e10-410e-bb41-693314a38797 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.342000 Jan 28 02:05:02.495004 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 566/1128] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Jan 28 02:05:02 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:03.803776 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-904371144", "imageRef": "a6af268e-63b7-4781-8934-3b6a72f267b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcd5597a-b815-4400-9cef-79a66efeb499"}], "security_groups": [{"name": "tempest-securitygroup--1210261736"}], "key_name": "tempest-keypair-1011285764", "user_data": "}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:03.945162 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] validate_networks() for [('fcd5597a-b815-4400-9cef-79a66efeb499', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:05:04.331251 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:05:04.331681 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:05:04.332304 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:05:04.332723 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:05:04.333162 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:05:04.342190 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:04.342647 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:04.343458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:04.343894 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:04.360825 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for project a20883c8bb00403490e966953c48afa7. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:05:04.364766 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Getting quotas for user cb4b6e4c21f34cbd8d89686ce74fe07a and project a20883c8bb00403490e966953c48afa7. Resources: {'instances', 'cores', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:05:04.376379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:05:04.378801 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a6af268e-63b7-4781-8934-3b6a72f267b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:05:04.427143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-87ca0cbd-a92c-4889-9e9a-ab7137f4f09a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627483 Jan 28 02:05:04.427745 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 563/1129] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Jan 28 02:05:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:05:04.438098 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-406810b2-6a2b-447e-adc8-8033725b60fc tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:04.438760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-406810b2-6a2b-447e-adc8-8033725b60fc tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:04.509292 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-406810b2-6a2b-447e-adc8-8033725b60fc tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:04.516775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-406810b2-6a2b-447e-adc8-8033725b60fc tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1237 microversion: 2.1 time: 0.082900 Jan 28 02:05:04.518423 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 567/1130] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:04 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:05.541505 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fb7fc8ac-a53d-4aa9-b1e2-634316abc42d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:05.542026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fb7fc8ac-a53d-4aa9-b1e2-634316abc42d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:05.553999 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb7fc8ac-a53d-4aa9-b1e2-634316abc42d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:05.554444 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb7fc8ac-a53d-4aa9-b1e2-634316abc42d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:05.555272 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb7fc8ac-a53d-4aa9-b1e2-634316abc42d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:05.555658 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fb7fc8ac-a53d-4aa9-b1e2-634316abc42d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:05.664929 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fb7fc8ac-a53d-4aa9-b1e2-634316abc42d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:05.673185 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fb7fc8ac-a53d-4aa9-b1e2-634316abc42d tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1297 microversion: 2.1 time: 0.135454 Jan 28 02:05:05.674079 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 564/1131] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:05 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1297 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:05:06.693698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b6ca8ae4-ef41-452b-a83e-85ba48a85bc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:06.695451 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b6ca8ae4-ef41-452b-a83e-85ba48a85bc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:06.706372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6ca8ae4-ef41-452b-a83e-85ba48a85bc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:06.706989 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6ca8ae4-ef41-452b-a83e-85ba48a85bc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:06.708019 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6ca8ae4-ef41-452b-a83e-85ba48a85bc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:06.708650 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6ca8ae4-ef41-452b-a83e-85ba48a85bc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:06.944154 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b6ca8ae4-ef41-452b-a83e-85ba48a85bc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:06.951915 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b6ca8ae4-ef41-452b-a83e-85ba48a85bc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.264123 Jan 28 02:05:06.952486 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 568/1132] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:06 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:07.073975 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-81bb8c0a-1c4a-45c9-90bd-23a5d1339b1c req-dc39f718-45ed-4ba4-b3cf-ada8e9be46f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a917e6e7-e0b8-462a-a263-b92b3907fe5a", "tag": "43ae90d8-af01-4a48-83fb-df3ffbe42efc"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:07.076789 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:07.076789 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:05:07.086434 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-81bb8c0a-1c4a-45c9-90bd-23a5d1339b1c req-dc39f718-45ed-4ba4-b3cf-ada8e9be46f4 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:07.086903 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-81bb8c0a-1c4a-45c9-90bd-23a5d1339b1c req-dc39f718-45ed-4ba4-b3cf-ada8e9be46f4 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:07.099091 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-81bb8c0a-1c4a-45c9-90bd-23a5d1339b1c req-dc39f718-45ed-4ba4-b3cf-ada8e9be46f4 service nova] Creating event network-changed:43ae90d8-af01-4a48-83fb-df3ffbe42efc for instance a917e6e7-e0b8-462a-a263-b92b3907fe5a on hv-cinder-82497 Jan 28 02:05:07.104395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-81bb8c0a-1c4a-45c9-90bd-23a5d1339b1c req-dc39f718-45ed-4ba4-b3cf-ada8e9be46f4 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040625 Jan 28 02:05:07.105310 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 565/1133] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:07.968918 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1cbae080-5c90-4486-a066-7d82a8a2c626 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:07.969431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1cbae080-5c90-4486-a066-7d82a8a2c626 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:07.975089 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1cbae080-5c90-4486-a066-7d82a8a2c626 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:07.975537 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1cbae080-5c90-4486-a066-7d82a8a2c626 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:07.976300 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1cbae080-5c90-4486-a066-7d82a8a2c626 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:07.976745 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1cbae080-5c90-4486-a066-7d82a8a2c626 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:08.173173 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1cbae080-5c90-4486-a066-7d82a8a2c626 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:08.180590 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1cbae080-5c90-4486-a066-7d82a8a2c626 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.215496 Jan 28 02:05:08.186577 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 569/1134] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:07 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:09.198697 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b6e786be-9d08-4b6f-b5c5-3e9a46063a4a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:09.199306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b6e786be-9d08-4b6f-b5c5-3e9a46063a4a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:09.205453 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6e786be-9d08-4b6f-b5c5-3e9a46063a4a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:09.205905 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6e786be-9d08-4b6f-b5c5-3e9a46063a4a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:09.206671 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6e786be-9d08-4b6f-b5c5-3e9a46063a4a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:09.207110 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6e786be-9d08-4b6f-b5c5-3e9a46063a4a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:09.331945 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b6e786be-9d08-4b6f-b5c5-3e9a46063a4a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:09.339965 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b6e786be-9d08-4b6f-b5c5-3e9a46063a4a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.145324 Jan 28 02:05:09.341152 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 566/1135] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:09 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:10.358269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e3210653-f53b-4fc0-bb5b-4f31699eb7bd tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:10.358901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e3210653-f53b-4fc0-bb5b-4f31699eb7bd tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:10.364710 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3210653-f53b-4fc0-bb5b-4f31699eb7bd tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:10.365187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3210653-f53b-4fc0-bb5b-4f31699eb7bd tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:10.365981 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3210653-f53b-4fc0-bb5b-4f31699eb7bd tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:10.366413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3210653-f53b-4fc0-bb5b-4f31699eb7bd tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:10.485504 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e3210653-f53b-4fc0-bb5b-4f31699eb7bd tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:10.493139 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e3210653-f53b-4fc0-bb5b-4f31699eb7bd tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.139047 Jan 28 02:05:10.493818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 570/1136] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:10 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:11.510532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e5a64055-5998-49b0-9c0b-6f5e9578ebbf tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:11.511160 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e5a64055-5998-49b0-9c0b-6f5e9578ebbf tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:11.518335 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5a64055-5998-49b0-9c0b-6f5e9578ebbf tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:11.518832 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5a64055-5998-49b0-9c0b-6f5e9578ebbf tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:11.519648 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5a64055-5998-49b0-9c0b-6f5e9578ebbf tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:11.520110 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5a64055-5998-49b0-9c0b-6f5e9578ebbf tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:11.657206 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e5a64055-5998-49b0-9c0b-6f5e9578ebbf tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:11.665099 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e5a64055-5998-49b0-9c0b-6f5e9578ebbf tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.158247 Jan 28 02:05:11.666199 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 567/1137] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:11 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:12.682585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1ab2530a-ed7a-4307-9a8a-f25b93b0b5b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:12.683200 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1ab2530a-ed7a-4307-9a8a-f25b93b0b5b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:12.689777 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1ab2530a-ed7a-4307-9a8a-f25b93b0b5b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:12.690229 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1ab2530a-ed7a-4307-9a8a-f25b93b0b5b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:12.691001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1ab2530a-ed7a-4307-9a8a-f25b93b0b5b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:12.691445 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1ab2530a-ed7a-4307-9a8a-f25b93b0b5b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:12.810724 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1ab2530a-ed7a-4307-9a8a-f25b93b0b5b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:12.818030 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1ab2530a-ed7a-4307-9a8a-f25b93b0b5b2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.139118 Jan 28 02:05:12.818598 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 571/1138] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:12 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:13.834668 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b175ac94-c283-4d99-8900-c2edfb327615 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:13.835277 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b175ac94-c283-4d99-8900-c2edfb327615 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:13.841213 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b175ac94-c283-4d99-8900-c2edfb327615 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:13.841691 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b175ac94-c283-4d99-8900-c2edfb327615 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:13.842497 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b175ac94-c283-4d99-8900-c2edfb327615 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:13.842929 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b175ac94-c283-4d99-8900-c2edfb327615 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:13.970203 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b175ac94-c283-4d99-8900-c2edfb327615 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:13.977718 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b175ac94-c283-4d99-8900-c2edfb327615 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.146687 Jan 28 02:05:13.978283 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 568/1139] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:13 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:14.996852 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cf46fc37-caeb-4490-af52-a09eff97318e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:14.997674 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cf46fc37-caeb-4490-af52-a09eff97318e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:15.003482 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cf46fc37-caeb-4490-af52-a09eff97318e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:15.004020 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cf46fc37-caeb-4490-af52-a09eff97318e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:15.004725 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cf46fc37-caeb-4490-af52-a09eff97318e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:15.005188 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cf46fc37-caeb-4490-af52-a09eff97318e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:15.132316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cf46fc37-caeb-4490-af52-a09eff97318e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:15.140305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cf46fc37-caeb-4490-af52-a09eff97318e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.147330 Jan 28 02:05:15.140877 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 572/1140] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:14 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:16.158390 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c944c6d6-3908-4cb4-96e6-0765febf79be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:16.159423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c944c6d6-3908-4cb4-96e6-0765febf79be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:16.165548 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c944c6d6-3908-4cb4-96e6-0765febf79be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:16.165997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c944c6d6-3908-4cb4-96e6-0765febf79be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:16.166778 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c944c6d6-3908-4cb4-96e6-0765febf79be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:16.167206 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c944c6d6-3908-4cb4-96e6-0765febf79be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:16.289259 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c944c6d6-3908-4cb4-96e6-0765febf79be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:16.298405 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c944c6d6-3908-4cb4-96e6-0765febf79be tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.144516 Jan 28 02:05:16.299278 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 569/1141] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:16 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:17.315979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-227dcf7f-b7ce-4ee5-b9d6-dc50e2057955 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:17.316623 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-227dcf7f-b7ce-4ee5-b9d6-dc50e2057955 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:17.322687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-227dcf7f-b7ce-4ee5-b9d6-dc50e2057955 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:17.323147 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-227dcf7f-b7ce-4ee5-b9d6-dc50e2057955 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:17.323917 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-227dcf7f-b7ce-4ee5-b9d6-dc50e2057955 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:17.324358 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-227dcf7f-b7ce-4ee5-b9d6-dc50e2057955 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:17.449144 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-227dcf7f-b7ce-4ee5-b9d6-dc50e2057955 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:17.458497 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-227dcf7f-b7ce-4ee5-b9d6-dc50e2057955 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.146199 Jan 28 02:05:17.459146 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 573/1142] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:17 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:17.768708 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-6bec07da-c36c-4485-b663-62e19030dcad req-a82d6602-b120-4ca7-94e3-f43381163078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a917e6e7-e0b8-462a-a263-b92b3907fe5a", "name": "network-vif-plugged", "status": "completed", "tag": "43ae90d8-af01-4a48-83fb-df3ffbe42efc"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:17.770438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:17.770438 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:05:17.778425 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-6bec07da-c36c-4485-b663-62e19030dcad req-a82d6602-b120-4ca7-94e3-f43381163078 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:17.778955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-6bec07da-c36c-4485-b663-62e19030dcad req-a82d6602-b120-4ca7-94e3-f43381163078 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:17.793459 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-6bec07da-c36c-4485-b663-62e19030dcad req-a82d6602-b120-4ca7-94e3-f43381163078 service nova] Creating event network-vif-plugged:43ae90d8-af01-4a48-83fb-df3ffbe42efc for instance a917e6e7-e0b8-462a-a263-b92b3907fe5a on hv-cinder-82497 Jan 28 02:05:17.799136 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-6bec07da-c36c-4485-b663-62e19030dcad req-a82d6602-b120-4ca7-94e3-f43381163078 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034619 Jan 28 02:05:17.799792 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 570/1143] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:18.476269 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1b948745-23a7-4078-93d6-d43e51283b00 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:18.476842 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1b948745-23a7-4078-93d6-d43e51283b00 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:18.483351 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b948745-23a7-4078-93d6-d43e51283b00 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:18.483797 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b948745-23a7-4078-93d6-d43e51283b00 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:18.484550 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b948745-23a7-4078-93d6-d43e51283b00 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:18.485012 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b948745-23a7-4078-93d6-d43e51283b00 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:18.602180 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1b948745-23a7-4078-93d6-d43e51283b00 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:18.610659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1b948745-23a7-4078-93d6-d43e51283b00 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1363 microversion: 2.1 time: 0.137789 Jan 28 02:05:18.620364 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 574/1144] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:18 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:19.628753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ac9c5829-2689-4b50-a19d-8e6aa9039d50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:19.629474 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ac9c5829-2689-4b50-a19d-8e6aa9039d50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:19.635451 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac9c5829-2689-4b50-a19d-8e6aa9039d50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:19.635899 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac9c5829-2689-4b50-a19d-8e6aa9039d50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:19.636664 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac9c5829-2689-4b50-a19d-8e6aa9039d50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:19.637337 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac9c5829-2689-4b50-a19d-8e6aa9039d50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:19.758824 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ac9c5829-2689-4b50-a19d-8e6aa9039d50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:19.767091 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ac9c5829-2689-4b50-a19d-8e6aa9039d50 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1549 microversion: 2.1 time: 0.142230 Jan 28 02:05:19.767663 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 571/1145] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:19 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1549 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:05:19.784452 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dd68439c-8566-4923-a2e4-b304e29b605a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:19.784979 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dd68439c-8566-4923-a2e4-b304e29b605a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:19.791326 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd68439c-8566-4923-a2e4-b304e29b605a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:19.791776 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd68439c-8566-4923-a2e4-b304e29b605a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:19.792532 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd68439c-8566-4923-a2e4-b304e29b605a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:19.792997 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd68439c-8566-4923-a2e4-b304e29b605a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:19.881010 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dd68439c-8566-4923-a2e4-b304e29b605a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100309 Jan 28 02:05:19.881491 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 575/1146] 10.222.0.96 () {58 vars in 1274 bytes} [Fri Jan 28 02:05:19 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:21.085131 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c6cfa01f-f076-4d27-b624-2f28d8d5bf11 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:21.086078 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c6cfa01f-f076-4d27-b624-2f28d8d5bf11 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:21.086223 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-44d7272c-eaf0-4a55-b324-45472ac38aa6 req-5907f75e-1d1d-43e0-8d6d-9df08325e87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a917e6e7-e0b8-462a-a263-b92b3907fe5a", "tag": "43ae90d8-af01-4a48-83fb-df3ffbe42efc"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:21.087647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:21.087647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:05:21.093813 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6cfa01f-f076-4d27-b624-2f28d8d5bf11 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:21.094271 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6cfa01f-f076-4d27-b624-2f28d8d5bf11 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:21.095062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6cfa01f-f076-4d27-b624-2f28d8d5bf11 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:21.095501 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6cfa01f-f076-4d27-b624-2f28d8d5bf11 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:21.096205 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-44d7272c-eaf0-4a55-b324-45472ac38aa6 req-5907f75e-1d1d-43e0-8d6d-9df08325e87b service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:21.097271 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-44d7272c-eaf0-4a55-b324-45472ac38aa6 req-5907f75e-1d1d-43e0-8d6d-9df08325e87b service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:21.112282 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-44d7272c-eaf0-4a55-b324-45472ac38aa6 req-5907f75e-1d1d-43e0-8d6d-9df08325e87b service nova] Creating event network-changed:43ae90d8-af01-4a48-83fb-df3ffbe42efc for instance a917e6e7-e0b8-462a-a263-b92b3907fe5a on hv-cinder-82497 Jan 28 02:05:21.122294 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-44d7272c-eaf0-4a55-b324-45472ac38aa6 req-5907f75e-1d1d-43e0-8d6d-9df08325e87b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039089 Jan 28 02:05:21.123271 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 576/1147] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:21.234404 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c6cfa01f-f076-4d27-b624-2f28d8d5bf11 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.155197 Jan 28 02:05:21.238598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 572/1148] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:21 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:22.246492 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e2e76464-d6a1-4912-892a-c011b6eb426c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:22.247669 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e2e76464-d6a1-4912-892a-c011b6eb426c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:22.254383 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2e76464-d6a1-4912-892a-c011b6eb426c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:22.254830 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2e76464-d6a1-4912-892a-c011b6eb426c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:22.255593 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2e76464-d6a1-4912-892a-c011b6eb426c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:22.256235 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2e76464-d6a1-4912-892a-c011b6eb426c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:22.355646 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e2e76464-d6a1-4912-892a-c011b6eb426c tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.113017 Jan 28 02:05:22.357059 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 577/1149] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:22 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:23.368112 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-981af658-088f-4c95-8421-26fb90986f39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:23.369143 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-981af658-088f-4c95-8421-26fb90986f39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:23.376534 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-981af658-088f-4c95-8421-26fb90986f39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:23.377018 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-981af658-088f-4c95-8421-26fb90986f39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:23.377797 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-981af658-088f-4c95-8421-26fb90986f39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:23.378231 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-981af658-088f-4c95-8421-26fb90986f39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:23.486561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-981af658-088f-4c95-8421-26fb90986f39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.122297 Jan 28 02:05:23.488312 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 573/1150] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:23 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:24.499858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2c05a5da-bea9-4a9e-b2d6-338cd9da17d5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:24.500866 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2c05a5da-bea9-4a9e-b2d6-338cd9da17d5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:24.507431 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c05a5da-bea9-4a9e-b2d6-338cd9da17d5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:24.507905 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c05a5da-bea9-4a9e-b2d6-338cd9da17d5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:24.508679 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c05a5da-bea9-4a9e-b2d6-338cd9da17d5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:24.509131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c05a5da-bea9-4a9e-b2d6-338cd9da17d5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:24.618806 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2c05a5da-bea9-4a9e-b2d6-338cd9da17d5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.122867 Jan 28 02:05:24.619487 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 578/1151] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:24 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:25.631502 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ab8b42da-9be5-4e19-85e2-1f33d8123bad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:25.632485 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ab8b42da-9be5-4e19-85e2-1f33d8123bad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:25.638952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab8b42da-9be5-4e19-85e2-1f33d8123bad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:25.639395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab8b42da-9be5-4e19-85e2-1f33d8123bad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:25.640159 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab8b42da-9be5-4e19-85e2-1f33d8123bad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:25.640585 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab8b42da-9be5-4e19-85e2-1f33d8123bad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:25.735327 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ab8b42da-9be5-4e19-85e2-1f33d8123bad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.107627 Jan 28 02:05:25.736629 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 574/1152] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:25 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:26.746372 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e93d5f2e-2ecc-487d-98a7-40e161c4a318 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:26.747577 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e93d5f2e-2ecc-487d-98a7-40e161c4a318 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:26.754235 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e93d5f2e-2ecc-487d-98a7-40e161c4a318 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:26.754685 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e93d5f2e-2ecc-487d-98a7-40e161c4a318 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:26.755458 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e93d5f2e-2ecc-487d-98a7-40e161c4a318 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:26.755895 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e93d5f2e-2ecc-487d-98a7-40e161c4a318 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:26.859935 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e93d5f2e-2ecc-487d-98a7-40e161c4a318 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.117513 Jan 28 02:05:26.860604 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 579/1153] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:26 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:05:27.871675 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-50ec830e-7118-4c6b-ab06-c93d1eb2dccb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:27.872620 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-50ec830e-7118-4c6b-ab06-c93d1eb2dccb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:27.879817 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50ec830e-7118-4c6b-ab06-c93d1eb2dccb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:27.880261 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50ec830e-7118-4c6b-ab06-c93d1eb2dccb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:27.881062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50ec830e-7118-4c6b-ab06-c93d1eb2dccb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:27.881504 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50ec830e-7118-4c6b-ab06-c93d1eb2dccb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:27.985656 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-50ec830e-7118-4c6b-ab06-c93d1eb2dccb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.118197 Jan 28 02:05:27.986293 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 575/1154] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:27 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:28.997110 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b2ae80a4-ae14-477e-b773-4572bff49de5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:28.998187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b2ae80a4-ae14-477e-b773-4572bff49de5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:29.005838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2ae80a4-ae14-477e-b773-4572bff49de5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:29.006291 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2ae80a4-ae14-477e-b773-4572bff49de5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:29.007114 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2ae80a4-ae14-477e-b773-4572bff49de5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:29.007554 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2ae80a4-ae14-477e-b773-4572bff49de5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:29.092732 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b2ae80a4-ae14-477e-b773-4572bff49de5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.099543 Jan 28 02:05:29.093435 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 580/1155] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:28 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:30.105020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3a582cdb-6757-4e9a-a3ac-88439d3863ab tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:30.106051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3a582cdb-6757-4e9a-a3ac-88439d3863ab tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:30.112654 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a582cdb-6757-4e9a-a3ac-88439d3863ab tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:30.113124 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a582cdb-6757-4e9a-a3ac-88439d3863ab tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:30.113895 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a582cdb-6757-4e9a-a3ac-88439d3863ab tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:30.114332 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a582cdb-6757-4e9a-a3ac-88439d3863ab tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:30.222886 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3a582cdb-6757-4e9a-a3ac-88439d3863ab tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.121874 Jan 28 02:05:30.223521 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 576/1156] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:30 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:05:31.235774 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da10036a-097f-4af5-8baa-b2966c7e534f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:31.236914 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-da10036a-097f-4af5-8baa-b2966c7e534f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:31.243625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da10036a-097f-4af5-8baa-b2966c7e534f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:31.244073 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da10036a-097f-4af5-8baa-b2966c7e534f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:31.244888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da10036a-097f-4af5-8baa-b2966c7e534f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:31.245329 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da10036a-097f-4af5-8baa-b2966c7e534f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:31.345414 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-da10036a-097f-4af5-8baa-b2966c7e534f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.114867 Jan 28 02:05:31.346178 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 581/1157] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:31 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:32.356931 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-def9cf40-e909-4536-a3bb-7fbe631d03d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:32.358408 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-def9cf40-e909-4536-a3bb-7fbe631d03d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:32.365051 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-def9cf40-e909-4536-a3bb-7fbe631d03d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:32.365527 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-def9cf40-e909-4536-a3bb-7fbe631d03d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:32.366290 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-def9cf40-e909-4536-a3bb-7fbe631d03d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:32.366722 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-def9cf40-e909-4536-a3bb-7fbe631d03d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:32.468114 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-def9cf40-e909-4536-a3bb-7fbe631d03d2 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.114349 Jan 28 02:05:32.468563 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 577/1158] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:32 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:33.479441 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-db475b57-2573-4951-b63a-9c0c7c12246b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:33.480382 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-db475b57-2573-4951-b63a-9c0c7c12246b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:33.487136 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db475b57-2573-4951-b63a-9c0c7c12246b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:33.487578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db475b57-2573-4951-b63a-9c0c7c12246b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:33.488339 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db475b57-2573-4951-b63a-9c0c7c12246b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:33.488770 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db475b57-2573-4951-b63a-9c0c7c12246b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:33.597621 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-db475b57-2573-4951-b63a-9c0c7c12246b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.122227 Jan 28 02:05:33.598259 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 582/1159] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:33 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:34.609008 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2d66ce35-ccf4-468d-a099-694d30001d46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:34.610015 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2d66ce35-ccf4-468d-a099-694d30001d46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:34.616983 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d66ce35-ccf4-468d-a099-694d30001d46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:34.617435 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d66ce35-ccf4-468d-a099-694d30001d46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:34.618219 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d66ce35-ccf4-468d-a099-694d30001d46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:34.618653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d66ce35-ccf4-468d-a099-694d30001d46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:34.731997 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2d66ce35-ccf4-468d-a099-694d30001d46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 14 microversion: 2.1 time: 0.126888 Jan 28 02:05:34.732669 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 578/1160] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:34 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:35.743561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d50c04cd-7af3-4ea8-a707-4e1b0a07b4b4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:35.744567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d50c04cd-7af3-4ea8-a707-4e1b0a07b4b4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:35.751800 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d50c04cd-7af3-4ea8-a707-4e1b0a07b4b4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:35.752256 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d50c04cd-7af3-4ea8-a707-4e1b0a07b4b4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:35.753066 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d50c04cd-7af3-4ea8-a707-4e1b0a07b4b4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:35.753508 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d50c04cd-7af3-4ea8-a707-4e1b0a07b4b4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:35.867439 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d50c04cd-7af3-4ea8-a707-4e1b0a07b4b4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 6520 microversion: 2.1 time: 0.127642 Jan 28 02:05:35.868035 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 583/1161] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:35 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 6520 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:36.878755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2fc2071c-841f-44f0-abe5-09f470f85e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:36.879688 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2fc2071c-841f-44f0-abe5-09f470f85e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:36.886205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fc2071c-841f-44f0-abe5-09f470f85e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:36.886659 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fc2071c-841f-44f0-abe5-09f470f85e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:36.887426 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fc2071c-841f-44f0-abe5-09f470f85e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:36.887861 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fc2071c-841f-44f0-abe5-09f470f85e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:37.003631 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2fc2071c-841f-44f0-abe5-09f470f85e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 13243 microversion: 2.1 time: 0.128830 Jan 28 02:05:37.004492 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 579/1162] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:36 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 13243 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:38.016305 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d9fa4e23-8c33-4a66-bbdf-d2456ae594d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:38.017331 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d9fa4e23-8c33-4a66-bbdf-d2456ae594d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:38.023809 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9fa4e23-8c33-4a66-bbdf-d2456ae594d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.024256 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9fa4e23-8c33-4a66-bbdf-d2456ae594d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.025052 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9fa4e23-8c33-4a66-bbdf-d2456ae594d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.025489 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9fa4e23-8c33-4a66-bbdf-d2456ae594d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.145468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d9fa4e23-8c33-4a66-bbdf-d2456ae594d9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 17960 microversion: 2.1 time: 0.133721 Jan 28 02:05:38.146181 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 584/1163] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:38 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 17960 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:38.269034 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0b3f53ce-240f-4b87-8216-a094a9dbee32 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1660361959"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:38.269650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0b3f53ce-240f-4b87-8216-a094a9dbee32 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:38.276170 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0b3f53ce-240f-4b87-8216-a094a9dbee32 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.276700 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0b3f53ce-240f-4b87-8216-a094a9dbee32 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.277408 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0b3f53ce-240f-4b87-8216-a094a9dbee32 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.277866 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0b3f53ce-240f-4b87-8216-a094a9dbee32 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.402798 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.network.security_group_api [None req-0b3f53ce-240f-4b87-8216-a094a9dbee32 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Removing security group 07e9ab82-2e26-4332-8813-31205d25f8fd from port f32c519b-1b2d-4daa-aab9-7451f40e2300 Jan 28 02:05:38.783238 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0b3f53ce-240f-4b87-8216-a094a9dbee32 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "POST /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/action" status: 202 len: 0 microversion: 2.1 time: 0.518034 Jan 28 02:05:38.784918 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 580/1164] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:38 2022] POST /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:05:38.800189 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-5e66aedc-1932-4ba8-8b35-a1047019ed14 req-c115137a-d69f-425e-9395-9228558f0953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6d5ac-655f-45b3-838b-02216f1bb988", "tag": "f32c519b-1b2d-4daa-aab9-7451f40e2300"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:38.807038 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:38.807038 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:05:38.816082 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-5e66aedc-1932-4ba8-8b35-a1047019ed14 req-c115137a-d69f-425e-9395-9228558f0953 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:38.816548 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-5e66aedc-1932-4ba8-8b35-a1047019ed14 req-c115137a-d69f-425e-9395-9228558f0953 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:38.847928 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-5e66aedc-1932-4ba8-8b35-a1047019ed14 req-c115137a-d69f-425e-9395-9228558f0953 service nova] Creating event network-changed:f32c519b-1b2d-4daa-aab9-7451f40e2300 for instance 46b6d5ac-655f-45b3-838b-02216f1bb988 on hv-cinder-82497 Jan 28 02:05:38.861720 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-5e66aedc-1932-4ba8-8b35-a1047019ed14 req-c115137a-d69f-425e-9395-9228558f0953 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068251 Jan 28 02:05:38.862989 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 585/1165] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:39.158365 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e0edab08-e640-4679-8377-1fdc93097a3a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:39.160019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e0edab08-e640-4679-8377-1fdc93097a3a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:39.167189 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0edab08-e640-4679-8377-1fdc93097a3a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:39.167957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0edab08-e640-4679-8377-1fdc93097a3a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:39.169126 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0edab08-e640-4679-8377-1fdc93097a3a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:39.169578 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0edab08-e640-4679-8377-1fdc93097a3a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:39.285619 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e0edab08-e640-4679-8377-1fdc93097a3a tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 18083 microversion: 2.1 time: 0.131667 Jan 28 02:05:39.287415 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 581/1166] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:39 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 18083 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:40.031324 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5125f470-96e6-41de-a3e8-736bc70b2643 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:40.032268 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5125f470-96e6-41de-a3e8-736bc70b2643 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:40.034001 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-34f70df2-f7f2-4fbd-baf9-1464e1b00796 req-f7537071-81a6-4ea1-81fb-13efe84a9e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6d5ac-655f-45b3-838b-02216f1bb988", "tag": "f32c519b-1b2d-4daa-aab9-7451f40e2300"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:40.035928 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:40.035928 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:05:40.039434 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5125f470-96e6-41de-a3e8-736bc70b2643 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.039883 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5125f470-96e6-41de-a3e8-736bc70b2643 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.040669 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5125f470-96e6-41de-a3e8-736bc70b2643 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.041137 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5125f470-96e6-41de-a3e8-736bc70b2643 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.046131 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-34f70df2-f7f2-4fbd-baf9-1464e1b00796 req-f7537071-81a6-4ea1-81fb-13efe84a9e3d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.047097 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-34f70df2-f7f2-4fbd-baf9-1464e1b00796 req-f7537071-81a6-4ea1-81fb-13efe84a9e3d service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.060545 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-34f70df2-f7f2-4fbd-baf9-1464e1b00796 req-f7537071-81a6-4ea1-81fb-13efe84a9e3d service nova] Creating event network-changed:f32c519b-1b2d-4daa-aab9-7451f40e2300 for instance 46b6d5ac-655f-45b3-838b-02216f1bb988 on hv-cinder-82497 Jan 28 02:05:40.066653 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-34f70df2-f7f2-4fbd-baf9-1464e1b00796 req-f7537071-81a6-4ea1-81fb-13efe84a9e3d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037971 Jan 28 02:05:40.067677 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 582/1167] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:05:40.151320 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-5125f470-96e6-41de-a3e8-736bc70b2643 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lazy-loading 'services' on Instance uuid 46b6d5ac-655f-45b3-838b-02216f1bb988 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:05:40.234199 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5125f470-96e6-41de-a3e8-736bc70b2643 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "DELETE /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments/6a0d8e57-048e-4c30-bb4b-eccacb699dbd" status: 202 len: 0 microversion: 2.1 time: 0.207017 Jan 28 02:05:40.238327 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 586/1168] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:05:40 2022] DELETE /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments/6a0d8e57-048e-4c30-bb4b-eccacb699dbd => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:05:40.244003 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-894fd866-1c73-4d23-b8f7-cd6fd3457827 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:40.245298 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-894fd866-1c73-4d23-b8f7-cd6fd3457827 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:40.251952 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-894fd866-1c73-4d23-b8f7-cd6fd3457827 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.252689 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-894fd866-1c73-4d23-b8f7-cd6fd3457827 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.253536 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-894fd866-1c73-4d23-b8f7-cd6fd3457827 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.253972 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-894fd866-1c73-4d23-b8f7-cd6fd3457827 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.286337 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-894fd866-1c73-4d23-b8f7-cd6fd3457827 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Jan 28 02:05:40.288067 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 583/1169] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:05:40 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:40.298889 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d6478362-d1d5-4768-9586-a94df68c4255 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:40.299899 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d6478362-d1d5-4768-9586-a94df68c4255 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:40.306048 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d6478362-d1d5-4768-9586-a94df68c4255 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.306490 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d6478362-d1d5-4768-9586-a94df68c4255 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.307472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d6478362-d1d5-4768-9586-a94df68c4255 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:40.308054 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d6478362-d1d5-4768-9586-a94df68c4255 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:40.415695 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d6478362-d1d5-4768-9586-a94df68c4255 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 19539 microversion: 2.1 time: 0.121930 Jan 28 02:05:40.416527 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 587/1170] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:40 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 19539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:41.300163 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-28e9dd18-c131-4150-a2ff-0b5632198402 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:41.301334 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-28e9dd18-c131-4150-a2ff-0b5632198402 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:41.307837 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-28e9dd18-c131-4150-a2ff-0b5632198402 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:41.308312 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-28e9dd18-c131-4150-a2ff-0b5632198402 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:41.309211 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-28e9dd18-c131-4150-a2ff-0b5632198402 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:41.309738 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-28e9dd18-c131-4150-a2ff-0b5632198402 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:41.340617 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-28e9dd18-c131-4150-a2ff-0b5632198402 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Jan 28 02:05:41.341237 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 584/1171] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:05:41 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:05:41.429237 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-747c844f-9029-4a42-a6e2-1a061339026e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:41.430246 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-747c844f-9029-4a42-a6e2-1a061339026e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:41.438270 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-747c844f-9029-4a42-a6e2-1a061339026e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:41.438732 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-747c844f-9029-4a42-a6e2-1a061339026e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:41.439551 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-747c844f-9029-4a42-a6e2-1a061339026e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:41.440049 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-747c844f-9029-4a42-a6e2-1a061339026e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:41.537410 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-747c844f-9029-4a42-a6e2-1a061339026e tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 22015 microversion: 2.1 time: 0.112160 Jan 28 02:05:41.538059 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 588/1172] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:41 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 22015 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:05:42.352652 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1de11a07-a8b2-4e47-98d1-a44a2ff14163 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:42.353490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1de11a07-a8b2-4e47-98d1-a44a2ff14163 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:42.359441 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1de11a07-a8b2-4e47-98d1-a44a2ff14163 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.359891 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1de11a07-a8b2-4e47-98d1-a44a2ff14163 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.360678 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1de11a07-a8b2-4e47-98d1-a44a2ff14163 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.361152 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1de11a07-a8b2-4e47-98d1-a44a2ff14163 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.394336 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1de11a07-a8b2-4e47-98d1-a44a2ff14163 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045712 Jan 28 02:05:42.394922 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 585/1173] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:05:42 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:05:42.406278 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:42.406888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:42.413886 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.414350 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.415143 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.415582 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.503580 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] HTTP exception thrown: Instance 46b6d5ac-655f-45b3-838b-02216f1bb988 is not attached to volume 6a0d8e57-048e-4c30-bb4b-eccacb699dbd Jan 28 02:05:42.504304 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Returning 404 to user: Instance 46b6d5ac-655f-45b3-838b-02216f1bb988 is not attached to volume 6a0d8e57-048e-4c30-bb4b-eccacb699dbd {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:42.505062 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dc201bf8-dd64-4461-8eb8-963bb7ec02c9 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "DELETE /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments/6a0d8e57-048e-4c30-bb4b-eccacb699dbd" status: 404 len: 154 microversion: 2.1 time: 0.103608 Jan 28 02:05:42.505631 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 589/1174] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:05:42 2022] DELETE /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988/os-volume_attachments/6a0d8e57-048e-4c30-bb4b-eccacb699dbd => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:42.552877 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4204a9be-9271-418a-a2ae-0eb58ead0409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:42.554442 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4204a9be-9271-418a-a2ae-0eb58ead0409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:42.563157 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4204a9be-9271-418a-a2ae-0eb58ead0409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.563916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4204a9be-9271-418a-a2ae-0eb58ead0409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.564722 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4204a9be-9271-418a-a2ae-0eb58ead0409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:42.565201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4204a9be-9271-418a-a2ae-0eb58ead0409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:42.665086 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4204a9be-9271-418a-a2ae-0eb58ead0409 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 23229 microversion: 2.1 time: 0.118486 Jan 28 02:05:42.665734 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 586/1175] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:42 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 23229 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:43.668489 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-19b38c81-27a2-4e95-b1a7-57d6b2215e1c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:43.669196 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-19b38c81-27a2-4e95-b1a7-57d6b2215e1c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:43.676344 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19b38c81-27a2-4e95-b1a7-57d6b2215e1c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:43.676814 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19b38c81-27a2-4e95-b1a7-57d6b2215e1c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:43.677602 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19b38c81-27a2-4e95-b1a7-57d6b2215e1c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:43.678045 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19b38c81-27a2-4e95-b1a7-57d6b2215e1c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:43.679923 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-be066127-7f2f-4173-a2b6-2591f2803475 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:43.681777 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-be066127-7f2f-4173-a2b6-2591f2803475 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:43.702317 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-be066127-7f2f-4173-a2b6-2591f2803475 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:43.703369 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-be066127-7f2f-4173-a2b6-2591f2803475 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:43.704742 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-be066127-7f2f-4173-a2b6-2591f2803475 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:43.705542 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-be066127-7f2f-4173-a2b6-2591f2803475 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:43.708859 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-19b38c81-27a2-4e95-b1a7-57d6b2215e1c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:05:43.797332 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-19b38c81-27a2-4e95-b1a7-57d6b2215e1c tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "DELETE /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 204 len: 0 microversion: 2.1 time: 0.131508 Jan 28 02:05:43.798766 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 590/1176] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:05:43 2022] DELETE /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:05:43.813499 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bfe201e9-178e-485a-bad2-c629aa4f1b93 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:43.814794 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bfe201e9-178e-485a-bad2-c629aa4f1b93 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:43.825433 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bfe201e9-178e-485a-bad2-c629aa4f1b93 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:43.826247 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bfe201e9-178e-485a-bad2-c629aa4f1b93 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:43.827750 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bfe201e9-178e-485a-bad2-c629aa4f1b93 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:43.828549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bfe201e9-178e-485a-bad2-c629aa4f1b93 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:43.834340 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-be066127-7f2f-4173-a2b6-2591f2803475 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 24966 microversion: 2.1 time: 0.159323 Jan 28 02:05:43.835556 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 587/1177] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:43 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 24966 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:43.999316 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bfe201e9-178e-485a-bad2-c629aa4f1b93 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:44.006859 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bfe201e9-178e-485a-bad2-c629aa4f1b93 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1552 microversion: 2.1 time: 0.201133 Jan 28 02:05:44.007427 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 591/1178] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:43 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1552 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:44.847516 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ba3296b5-9c48-4a94-ba93-7f6070669569 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:44.848457 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ba3296b5-9c48-4a94-ba93-7f6070669569 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:44.855174 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba3296b5-9c48-4a94-ba93-7f6070669569 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:44.855628 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba3296b5-9c48-4a94-ba93-7f6070669569 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:44.856411 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba3296b5-9c48-4a94-ba93-7f6070669569 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:44.856879 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba3296b5-9c48-4a94-ba93-7f6070669569 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:44.970739 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ba3296b5-9c48-4a94-ba93-7f6070669569 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 26232 microversion: 2.1 time: 0.127429 Jan 28 02:05:44.971395 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 588/1179] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:44 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 26232 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:45.026017 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b2971d00-a7b7-4225-bbbd-fee41c6fd3b8 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:45.026640 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b2971d00-a7b7-4225-bbbd-fee41c6fd3b8 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:45.032790 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2971d00-a7b7-4225-bbbd-fee41c6fd3b8 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:45.033279 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2971d00-a7b7-4225-bbbd-fee41c6fd3b8 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:45.034064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2971d00-a7b7-4225-bbbd-fee41c6fd3b8 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:45.034760 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2971d00-a7b7-4225-bbbd-fee41c6fd3b8 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:45.165958 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b2971d00-a7b7-4225-bbbd-fee41c6fd3b8 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:45.174042 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b2971d00-a7b7-4225-bbbd-fee41c6fd3b8 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1552 microversion: 2.1 time: 0.151783 Jan 28 02:05:45.174612 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 592/1180] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:45 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:45.983640 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c0645a9e-464d-415f-9c62-7d1037039ab9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:45.984556 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c0645a9e-464d-415f-9c62-7d1037039ab9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:45.991755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0645a9e-464d-415f-9c62-7d1037039ab9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:45.992214 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0645a9e-464d-415f-9c62-7d1037039ab9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:45.993043 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0645a9e-464d-415f-9c62-7d1037039ab9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:45.993478 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0645a9e-464d-415f-9c62-7d1037039ab9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:46.088632 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c0645a9e-464d-415f-9c62-7d1037039ab9 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 27116 microversion: 2.1 time: 0.109456 Jan 28 02:05:46.089321 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 589/1181] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:45 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 27116 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:46.192273 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-26f46843-6663-4b12-9c03-2e76e91c87b1 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:46.193578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-26f46843-6663-4b12-9c03-2e76e91c87b1 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:46.200848 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-26f46843-6663-4b12-9c03-2e76e91c87b1 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:46.201325 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-26f46843-6663-4b12-9c03-2e76e91c87b1 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:46.203287 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-26f46843-6663-4b12-9c03-2e76e91c87b1 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:46.203919 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-26f46843-6663-4b12-9c03-2e76e91c87b1 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:46.443074 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-26f46843-6663-4b12-9c03-2e76e91c87b1 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2668984632674ed6b3d343244d92c623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f88b3ae05934fd8836d7e90cad61a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:05:46.450549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-26f46843-6663-4b12-9c03-2e76e91c87b1 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 200 len: 1552 microversion: 2.1 time: 0.261981 Jan 28 02:05:46.451131 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 593/1182] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:46 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 1552 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:05:46.634846 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-c6a5a818-b9c0-444d-9cd5-252354daaa5b req-114dd4cc-7447-4724-abf9-2fe1d73abbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b6d5ac-655f-45b3-838b-02216f1bb988", "name": "network-vif-deleted", "tag": "f32c519b-1b2d-4daa-aab9-7451f40e2300"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:46.637187 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:05:46.637187 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:05:46.645036 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c6a5a818-b9c0-444d-9cd5-252354daaa5b req-114dd4cc-7447-4724-abf9-2fe1d73abbf8 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:46.645912 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c6a5a818-b9c0-444d-9cd5-252354daaa5b req-114dd4cc-7447-4724-abf9-2fe1d73abbf8 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:46.657552 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-c6a5a818-b9c0-444d-9cd5-252354daaa5b req-114dd4cc-7447-4724-abf9-2fe1d73abbf8 service nova] Creating event network-vif-deleted:f32c519b-1b2d-4daa-aab9-7451f40e2300 for instance 46b6d5ac-655f-45b3-838b-02216f1bb988 on hv-cinder-82497 Jan 28 02:05:46.664015 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-c6a5a818-b9c0-444d-9cd5-252354daaa5b req-114dd4cc-7447-4724-abf9-2fe1d73abbf8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034836 Jan 28 02:05:46.665573 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 590/1183] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:05:47.100520 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d9af4677-1d4c-48cb-9079-a2d226f68713 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:47.101523 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d9af4677-1d4c-48cb-9079-a2d226f68713 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:47.107428 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9af4677-1d4c-48cb-9079-a2d226f68713 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:47.108009 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9af4677-1d4c-48cb-9079-a2d226f68713 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:47.109033 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9af4677-1d4c-48cb-9079-a2d226f68713 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:47.109469 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9af4677-1d4c-48cb-9079-a2d226f68713 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:47.219741 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d9af4677-1d4c-48cb-9079-a2d226f68713 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 27806 microversion: 2.1 time: 0.122616 Jan 28 02:05:47.220396 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 594/1184] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:47 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 27806 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:47.468543 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:47.469288 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] [instance: 46b6d5ac-655f-45b3-838b-02216f1bb988] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:47.476402 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:47.476882 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:47.477671 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:47.478115 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:47.493208 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] HTTP exception thrown: Instance 46b6d5ac-655f-45b3-838b-02216f1bb988 could not be found. Jan 28 02:05:47.493851 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Returning 404 to user: Instance 46b6d5ac-655f-45b3-838b-02216f1bb988 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:05:47.494755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f4865aeb-69ea-40ec-87ee-8bd91ed8bc74 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988" status: 404 len: 111 microversion: 2.1 time: 0.030342 Jan 28 02:05:47.495366 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 591/1185] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:05:47 2022] GET /compute/v2.1/servers/46b6d5ac-655f-45b3-838b-02216f1bb988 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:47.504771 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-71e90276-2535-4d00-82a6-c84e4c3ba130 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] Calling method '.version_select at 0x7f523f2b6ca0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:05:47.523939 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-71e90276-2535-4d00-82a6-c84e4c3ba130 tempest-TestMinimumBasicScenario-158253638 tempest-TestMinimumBasicScenario-158253638-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-373663098" status: 202 len: 0 microversion: 2.1 time: 0.023038 Jan 28 02:05:47.524728 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 595/1186] 10.222.0.96 () {58 vars in 1268 bytes} [Fri Jan 28 02:05:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-373663098 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:05:48.231461 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8d86b907-13bd-46b8-909a-0ee854ed5620 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:48.232412 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8d86b907-13bd-46b8-909a-0ee854ed5620 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:48.239255 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d86b907-13bd-46b8-909a-0ee854ed5620 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:48.239702 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d86b907-13bd-46b8-909a-0ee854ed5620 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:48.240482 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d86b907-13bd-46b8-909a-0ee854ed5620 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:48.241107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d86b907-13bd-46b8-909a-0ee854ed5620 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:48.344056 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8d86b907-13bd-46b8-909a-0ee854ed5620 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 28234 microversion: 2.1 time: 0.116112 Jan 28 02:05:48.344849 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 592/1187] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:48 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 28234 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:05:49.364535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e8e02635-d909-463f-b65b-0aa24d17e5ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:49.365791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e8e02635-d909-463f-b65b-0aa24d17e5ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:49.372620 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8e02635-d909-463f-b65b-0aa24d17e5ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:49.373223 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8e02635-d909-463f-b65b-0aa24d17e5ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:49.374083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8e02635-d909-463f-b65b-0aa24d17e5ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:49.374516 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8e02635-d909-463f-b65b-0aa24d17e5ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:49.468081 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e8e02635-d909-463f-b65b-0aa24d17e5ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 28234 microversion: 2.1 time: 0.107199 Jan 28 02:05:49.468731 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 596/1188] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:49 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 28234 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:50.481720 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-79274ec4-3bce-4285-9251-c55a236758ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:50.483229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-79274ec4-3bce-4285-9251-c55a236758ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:50.490948 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79274ec4-3bce-4285-9251-c55a236758ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:50.491411 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79274ec4-3bce-4285-9251-c55a236758ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:50.492223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79274ec4-3bce-4285-9251-c55a236758ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:50.492896 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79274ec4-3bce-4285-9251-c55a236758ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:50.595540 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-79274ec4-3bce-4285-9251-c55a236758ad tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 28525 microversion: 2.1 time: 0.118433 Jan 28 02:05:50.596204 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 593/1189] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:50 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 28525 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:51.608386 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cdb867b5-96db-48ac-9f49-a16950a25c46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:51.609472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cdb867b5-96db-48ac-9f49-a16950a25c46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:51.616738 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cdb867b5-96db-48ac-9f49-a16950a25c46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:51.617217 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cdb867b5-96db-48ac-9f49-a16950a25c46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:51.618033 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cdb867b5-96db-48ac-9f49-a16950a25c46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:51.618475 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cdb867b5-96db-48ac-9f49-a16950a25c46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:51.721557 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cdb867b5-96db-48ac-9f49-a16950a25c46 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 28693 microversion: 2.1 time: 0.117507 Jan 28 02:05:51.722116 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 597/1190] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:51 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 28693 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:05:52.734847 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-103d9f71-b8c1-4633-9d52-1130a2de8de3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:52.735981 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-103d9f71-b8c1-4633-9d52-1130a2de8de3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:52.742423 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-103d9f71-b8c1-4633-9d52-1130a2de8de3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:52.742874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-103d9f71-b8c1-4633-9d52-1130a2de8de3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:52.743663 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-103d9f71-b8c1-4633-9d52-1130a2de8de3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:52.744094 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-103d9f71-b8c1-4633-9d52-1130a2de8de3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:52.995926 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-103d9f71-b8c1-4633-9d52-1130a2de8de3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 28693 microversion: 2.1 time: 0.266044 Jan 28 02:05:52.996791 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 594/1191] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:52 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 28693 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:54.008489 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e289f4bd-7525-4700-b9e8-7cab27ee9643 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:54.009683 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e289f4bd-7525-4700-b9e8-7cab27ee9643 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:54.018676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e289f4bd-7525-4700-b9e8-7cab27ee9643 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:54.019134 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e289f4bd-7525-4700-b9e8-7cab27ee9643 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:54.019921 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e289f4bd-7525-4700-b9e8-7cab27ee9643 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:54.020360 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e289f4bd-7525-4700-b9e8-7cab27ee9643 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:54.109608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e289f4bd-7525-4700-b9e8-7cab27ee9643 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 28693 microversion: 2.1 time: 0.105148 Jan 28 02:05:54.114505 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 598/1192] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:54 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 28693 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:05:55.362308 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-20eb3118-4005-49b3-8516-a16156f496ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:55.363916 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-20eb3118-4005-49b3-8516-a16156f496ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:55.370208 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20eb3118-4005-49b3-8516-a16156f496ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:55.370656 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20eb3118-4005-49b3-8516-a16156f496ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:55.371429 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20eb3118-4005-49b3-8516-a16156f496ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:55.371859 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-20eb3118-4005-49b3-8516-a16156f496ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:55.476724 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-20eb3118-4005-49b3-8516-a16156f496ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 29232 microversion: 2.1 time: 0.358399 Jan 28 02:05:55.477673 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 595/1193] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:55 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 29232 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:56.489717 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fe9bc2cb-7ded-4889-a388-ba16def7bfd6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:56.490746 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fe9bc2cb-7ded-4889-a388-ba16def7bfd6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:56.497302 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe9bc2cb-7ded-4889-a388-ba16def7bfd6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:56.497753 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe9bc2cb-7ded-4889-a388-ba16def7bfd6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:56.499191 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe9bc2cb-7ded-4889-a388-ba16def7bfd6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:56.499626 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe9bc2cb-7ded-4889-a388-ba16def7bfd6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:56.597898 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fe9bc2cb-7ded-4889-a388-ba16def7bfd6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 31517 microversion: 2.1 time: 0.111945 Jan 28 02:05:56.598599 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 599/1194] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:56 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 31517 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:57.610184 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b4702f10-cfe5-4596-b343-4c5d8a0576f5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:57.611191 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b4702f10-cfe5-4596-b343-4c5d8a0576f5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:57.619364 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4702f10-cfe5-4596-b343-4c5d8a0576f5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:57.619934 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4702f10-cfe5-4596-b343-4c5d8a0576f5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:57.620957 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4702f10-cfe5-4596-b343-4c5d8a0576f5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:57.621490 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4702f10-cfe5-4596-b343-4c5d8a0576f5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:57.714531 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b4702f10-cfe5-4596-b343-4c5d8a0576f5 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 33300 microversion: 2.1 time: 0.108151 Jan 28 02:05:57.715255 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 596/1195] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:57 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 33300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:58.727937 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8ffdee9e-b152-4e69-9527-b74d0b880ef8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:58.728968 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8ffdee9e-b152-4e69-9527-b74d0b880ef8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:58.736187 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ffdee9e-b152-4e69-9527-b74d0b880ef8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:58.736636 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ffdee9e-b152-4e69-9527-b74d0b880ef8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:58.737451 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ffdee9e-b152-4e69-9527-b74d0b880ef8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:58.737920 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ffdee9e-b152-4e69-9527-b74d0b880ef8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:58.834170 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8ffdee9e-b152-4e69-9527-b74d0b880ef8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 34335 microversion: 2.1 time: 0.110121 Jan 28 02:05:58.834754 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 600/1196] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:58 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 34335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:05:59.847857 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a099650b-3df4-46d6-9646-61de49e97e05 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:05:59.848765 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a099650b-3df4-46d6-9646-61de49e97e05 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:05:59.855113 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a099650b-3df4-46d6-9646-61de49e97e05 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:59.855559 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a099650b-3df4-46d6-9646-61de49e97e05 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:59.856320 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a099650b-3df4-46d6-9646-61de49e97e05 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:59.856750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a099650b-3df4-46d6-9646-61de49e97e05 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:59.946782 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a099650b-3df4-46d6-9646-61de49e97e05 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 35472 microversion: 2.1 time: 0.102868 Jan 28 02:05:59.947425 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 597/1197] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:05:59 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 35472 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:00.959141 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e6a47c06-cf9e-4391-8fc8-eda440b25ddb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:00.960048 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e6a47c06-cf9e-4391-8fc8-eda440b25ddb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:00.966535 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6a47c06-cf9e-4391-8fc8-eda440b25ddb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:00.967672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6a47c06-cf9e-4391-8fc8-eda440b25ddb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:00.968461 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6a47c06-cf9e-4391-8fc8-eda440b25ddb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:00.968912 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e6a47c06-cf9e-4391-8fc8-eda440b25ddb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:01.059051 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e6a47c06-cf9e-4391-8fc8-eda440b25ddb tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 37031 microversion: 2.1 time: 0.103830 Jan 28 02:06:01.059720 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 601/1198] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:06:00 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 37031 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:06:02.071522 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e112d789-e3bd-48bd-8fe5-efbcf220b153 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:02.072509 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e112d789-e3bd-48bd-8fe5-efbcf220b153 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:02.079629 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e112d789-e3bd-48bd-8fe5-efbcf220b153 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:02.080075 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e112d789-e3bd-48bd-8fe5-efbcf220b153 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:02.080862 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e112d789-e3bd-48bd-8fe5-efbcf220b153 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:02.081304 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e112d789-e3bd-48bd-8fe5-efbcf220b153 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:02.171379 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e112d789-e3bd-48bd-8fe5-efbcf220b153 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 38224 microversion: 2.1 time: 0.103547 Jan 28 02:06:02.172028 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 598/1199] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:06:02 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 38224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:03.183538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3d5965e7-290c-44af-b035-2fc2273ad601 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:03.184538 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3d5965e7-290c-44af-b035-2fc2273ad601 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:03.192386 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d5965e7-290c-44af-b035-2fc2273ad601 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:03.192863 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d5965e7-290c-44af-b035-2fc2273ad601 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:03.193647 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d5965e7-290c-44af-b035-2fc2273ad601 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:03.194084 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d5965e7-290c-44af-b035-2fc2273ad601 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:03.280739 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3d5965e7-290c-44af-b035-2fc2273ad601 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 38224 microversion: 2.1 time: 0.100139 Jan 28 02:06:03.281413 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 602/1200] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:06:03 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 38224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:04.292754 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e3eed3ef-5c89-4d2b-8f98-55b8126b407b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:04.293821 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e3eed3ef-5c89-4d2b-8f98-55b8126b407b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:04.300819 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e3eed3ef-5c89-4d2b-8f98-55b8126b407b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:04.301285 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e3eed3ef-5c89-4d2b-8f98-55b8126b407b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:04.302058 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e3eed3ef-5c89-4d2b-8f98-55b8126b407b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:04.302487 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e3eed3ef-5c89-4d2b-8f98-55b8126b407b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:04.389584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e3eed3ef-5c89-4d2b-8f98-55b8126b407b tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 38224 microversion: 2.1 time: 0.100069 Jan 28 02:06:04.390327 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 599/1201] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:06:04 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 38224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:05.402058 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c1afe0c2-697e-49b1-a571-c2cad86f0f95 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:05.403093 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c1afe0c2-697e-49b1-a571-c2cad86f0f95 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:05.411578 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1afe0c2-697e-49b1-a571-c2cad86f0f95 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:05.412354 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1afe0c2-697e-49b1-a571-c2cad86f0f95 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:05.413751 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1afe0c2-697e-49b1-a571-c2cad86f0f95 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:05.414524 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1afe0c2-697e-49b1-a571-c2cad86f0f95 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:05.504911 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c1afe0c2-697e-49b1-a571-c2cad86f0f95 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 38224 microversion: 2.1 time: 0.106600 Jan 28 02:06:05.505977 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 603/1202] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:06:05 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 38224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:06.520144 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-85167bc4-aeff-4336-8f99-ab40b2645336 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:06.521205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-85167bc4-aeff-4336-8f99-ab40b2645336 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:06.527512 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85167bc4-aeff-4336-8f99-ab40b2645336 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:06.527969 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85167bc4-aeff-4336-8f99-ab40b2645336 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:06.528755 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85167bc4-aeff-4336-8f99-ab40b2645336 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:06.529260 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85167bc4-aeff-4336-8f99-ab40b2645336 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:06.624119 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-85167bc4-aeff-4336-8f99-ab40b2645336 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action" status: 200 len: 38353 microversion: 2.1 time: 0.107249 Jan 28 02:06:06.624876 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 600/1203] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Jan 28 02:06:06 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/action => generated 38353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:06.635136 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d0318e5c-598c-4424-a197-aae4f7a8d3ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:06.635722 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d0318e5c-598c-4424-a197-aae4f7a8d3ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:06.642439 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d0318e5c-598c-4424-a197-aae4f7a8d3ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:06.642897 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d0318e5c-598c-4424-a197-aae4f7a8d3ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:06.643698 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d0318e5c-598c-4424-a197-aae4f7a8d3ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:06.644134 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d0318e5c-598c-4424-a197-aae4f7a8d3ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:06.666944 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d0318e5c-598c-4424-a197-aae4f7a8d3ef tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/ips" status: 200 len: 146 microversion: 2.1 time: 0.035802 Jan 28 02:06:06.668577 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 604/1204] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Jan 28 02:06:06 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:07.998767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b72ebbe2-3c4b-4eac-916a-b2e60352d300 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b9d16f0-75ec-4c1d-a7e7-acca500f9bbd"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:07.999912 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b72ebbe2-3c4b-4eac-916a-b2e60352d300 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:08.006406 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b72ebbe2-3c4b-4eac-916a-b2e60352d300 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:08.006868 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b72ebbe2-3c4b-4eac-916a-b2e60352d300 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:08.007644 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b72ebbe2-3c4b-4eac-916a-b2e60352d300 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:08.008084 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b72ebbe2-3c4b-4eac-916a-b2e60352d300 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:08.262211 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b72ebbe2-3c4b-4eac-916a-b2e60352d300 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267838 Jan 28 02:06:08.262813 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 601/1205] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 02:06:07 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:15.798048 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-80eab9de-f85d-4c42-b564-731c27bd1088 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:15.798957 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-80eab9de-f85d-4c42-b564-731c27bd1088 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:15.805242 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80eab9de-f85d-4c42-b564-731c27bd1088 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.805634 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80eab9de-f85d-4c42-b564-731c27bd1088 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.806394 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80eab9de-f85d-4c42-b564-731c27bd1088 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.806828 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80eab9de-f85d-4c42-b564-731c27bd1088 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.838959 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-80eab9de-f85d-4c42-b564-731c27bd1088 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Jan 28 02:06:15.839588 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 605/1206] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:06:15 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:15.851750 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e2c999ff-5073-4c21-a0da-e54adbf27db7 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:15.852349 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e2c999ff-5073-4c21-a0da-e54adbf27db7 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:15.859595 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e2c999ff-5073-4c21-a0da-e54adbf27db7 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.860109 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e2c999ff-5073-4c21-a0da-e54adbf27db7 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.860878 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e2c999ff-5073-4c21-a0da-e54adbf27db7 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.861318 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e2c999ff-5073-4c21-a0da-e54adbf27db7 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.893070 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e2c999ff-5073-4c21-a0da-e54adbf27db7 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/1b9d16f0-75ec-4c1d-a7e7-acca500f9bbd" status: 200 len: 194 microversion: 2.1 time: 0.045954 Jan 28 02:06:15.893669 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 602/1207] 10.222.0.96 () {58 vars in 1412 bytes} [Fri Jan 28 02:06:15 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/1b9d16f0-75ec-4c1d-a7e7-acca500f9bbd => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:17.242998 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e119eb94-c2ff-426b-a2cf-3fe3c3975d39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c91fcb29-3640-4ffb-a0f1-98b0baedd18a"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:17.244097 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e119eb94-c2ff-426b-a2cf-3fe3c3975d39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:17.250625 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e119eb94-c2ff-426b-a2cf-3fe3c3975d39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:17.251082 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e119eb94-c2ff-426b-a2cf-3fe3c3975d39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:17.251878 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e119eb94-c2ff-426b-a2cf-3fe3c3975d39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:17.252319 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e119eb94-c2ff-426b-a2cf-3fe3c3975d39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:17.561048 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e119eb94-c2ff-426b-a2cf-3fe3c3975d39 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321538 Jan 28 02:06:17.561667 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 606/1208] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Jan 28 02:06:17 2022] POST /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:22.860254 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0f82db90-21c2-40d8-9db6-eb6bbd9d6821 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:22.867835 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-f17aa78f-f683-4245-9423-f91c4f83cb5c req-f50a3f58-9104-4479-b243-2d0cf037c362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c241188c-6827-43b6-87ca-c196237b79d4", "tag": "a1c59218-2656-4158-91d1-b7d7e0447fb0"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:22.869329 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0f82db90-21c2-40d8-9db6-eb6bbd9d6821 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:22.873464 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:22.873464 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Jan 28 02:06:22.878363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f82db90-21c2-40d8-9db6-eb6bbd9d6821 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.879085 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f82db90-21c2-40d8-9db6-eb6bbd9d6821 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.880208 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f82db90-21c2-40d8-9db6-eb6bbd9d6821 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.880901 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f82db90-21c2-40d8-9db6-eb6bbd9d6821 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.888702 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-f17aa78f-f683-4245-9423-f91c4f83cb5c req-f50a3f58-9104-4479-b243-2d0cf037c362 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.889821 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-f17aa78f-f683-4245-9423-f91c4f83cb5c req-f50a3f58-9104-4479-b243-2d0cf037c362 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.913650 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-f17aa78f-f683-4245-9423-f91c4f83cb5c req-f50a3f58-9104-4479-b243-2d0cf037c362 service nova] Creating event network-changed:a1c59218-2656-4158-91d1-b7d7e0447fb0 for instance c241188c-6827-43b6-87ca-c196237b79d4 on hv-cinder-82497 Jan 28 02:06:22.916732 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0f82db90-21c2-40d8-9db6-eb6bbd9d6821 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:06:22.929337 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-f17aa78f-f683-4245-9423-f91c4f83cb5c req-f50a3f58-9104-4479-b243-2d0cf037c362 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066475 Jan 28 02:06:22.930983 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 607/1209] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:23.027150 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0f82db90-21c2-40d8-9db6-eb6bbd9d6821 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "DELETE /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 204 len: 0 microversion: 2.1 time: 0.172495 Jan 28 02:06:23.028363 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 603/1210] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:06:22 2022] DELETE /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:06:23.040448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2ba3f5c6-fe19-41ff-8b77-ffdcfc2e3309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:23.041198 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2ba3f5c6-fe19-41ff-8b77-ffdcfc2e3309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:23.048756 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2ba3f5c6-fe19-41ff-8b77-ffdcfc2e3309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:23.049271 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2ba3f5c6-fe19-41ff-8b77-ffdcfc2e3309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:23.050046 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2ba3f5c6-fe19-41ff-8b77-ffdcfc2e3309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:23.050498 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2ba3f5c6-fe19-41ff-8b77-ffdcfc2e3309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:23.465072 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2ba3f5c6-fe19-41ff-8b77-ffdcfc2e3309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:23.477737 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2ba3f5c6-fe19-41ff-8b77-ffdcfc2e3309 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1578 microversion: 2.1 time: 0.441341 Jan 28 02:06:23.478792 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 608/1211] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:23 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1578 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:24.509960 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5a6de126-ba9d-4bce-b7ba-0ca1783842e7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:24.511081 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5a6de126-ba9d-4bce-b7ba-0ca1783842e7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:24.517767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a6de126-ba9d-4bce-b7ba-0ca1783842e7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.518361 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a6de126-ba9d-4bce-b7ba-0ca1783842e7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.519518 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a6de126-ba9d-4bce-b7ba-0ca1783842e7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.520054 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a6de126-ba9d-4bce-b7ba-0ca1783842e7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.663306 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5a6de126-ba9d-4bce-b7ba-0ca1783842e7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:24.672131 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5a6de126-ba9d-4bce-b7ba-0ca1783842e7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1459 microversion: 2.1 time: 0.167539 Jan 28 02:06:24.672724 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 604/1212] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:24 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:25.236846 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0faa5b49-30ac-43f4-bfb5-b6a9aaac2690 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.237858 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0faa5b49-30ac-43f4-bfb5-b6a9aaac2690 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:25.244711 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0faa5b49-30ac-43f4-bfb5-b6a9aaac2690 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.245633 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0faa5b49-30ac-43f4-bfb5-b6a9aaac2690 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.246473 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0faa5b49-30ac-43f4-bfb5-b6a9aaac2690 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.246922 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0faa5b49-30ac-43f4-bfb5-b6a9aaac2690 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.289704 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0faa5b49-30ac-43f4-bfb5-b6a9aaac2690 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058217 Jan 28 02:06:25.291157 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 609/1213] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:25.521544 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-52427a3a-fcc3-4f78-80d1-36d9d2e35933 req-f112b43c-cabb-4eb2-b777-66650bab740c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c241188c-6827-43b6-87ca-c196237b79d4", "name": "network-vif-deleted", "tag": "a1c59218-2656-4158-91d1-b7d7e0447fb0"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:25.524022 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:25.524022 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:06:25.533726 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-52427a3a-fcc3-4f78-80d1-36d9d2e35933 req-f112b43c-cabb-4eb2-b777-66650bab740c service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.534557 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-52427a3a-fcc3-4f78-80d1-36d9d2e35933 req-f112b43c-cabb-4eb2-b777-66650bab740c service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.551236 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-52427a3a-fcc3-4f78-80d1-36d9d2e35933 req-f112b43c-cabb-4eb2-b777-66650bab740c service nova] Creating event network-vif-deleted:a1c59218-2656-4158-91d1-b7d7e0447fb0 for instance c241188c-6827-43b6-87ca-c196237b79d4 on hv-cinder-82497 Jan 28 02:06:25.560244 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-52427a3a-fcc3-4f78-80d1-36d9d2e35933 req-f112b43c-cabb-4eb2-b777-66650bab740c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044669 Jan 28 02:06:25.561627 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 605/1214] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:25.690841 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-49aba30b-3dad-438a-b59b-66461a7c1720 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.691460 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-49aba30b-3dad-438a-b59b-66461a7c1720 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:25.698056 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49aba30b-3dad-438a-b59b-66461a7c1720 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.698549 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49aba30b-3dad-438a-b59b-66461a7c1720 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.699285 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49aba30b-3dad-438a-b59b-66461a7c1720 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.699714 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49aba30b-3dad-438a-b59b-66461a7c1720 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.772974 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-49aba30b-3dad-438a-b59b-66461a7c1720 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:25.782605 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-49aba30b-3dad-438a-b59b-66461a7c1720 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 200 len: 1225 microversion: 2.1 time: 0.095955 Jan 28 02:06:25.783211 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 610/1215] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:26.801046 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:26.801828 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c241188c-6827-43b6-87ca-c196237b79d4] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:26.808286 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.808889 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.809704 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.810141 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.826187 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] HTTP exception thrown: Instance c241188c-6827-43b6-87ca-c196237b79d4 could not be found. Jan 28 02:06:26.826793 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Returning 404 to user: Instance c241188c-6827-43b6-87ca-c196237b79d4 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:26.827650 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-94e8d2d3-76f2-4b97-b902-5580f16161aa tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4" status: 404 len: 111 microversion: 2.1 time: 0.031227 Jan 28 02:06:26.828229 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 606/1216] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:26 2022] GET /compute/v2.1/servers/c241188c-6827-43b6-87ca-c196237b79d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:30.041340 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ebaa9f60-ee7a-4588-9408-0ea841b2a468 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:30.041880 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ebaa9f60-ee7a-4588-9408-0ea841b2a468 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:30.043561 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-b6117597-54ee-4139-b786-35c017ce68a8 req-543b89d0-9a62-4f90-b98e-b674c4e1e6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c097440e-be71-4ec9-a745-018fb72e47c8", "tag": "eb1cbd46-e972-417e-b2bd-3fa5d34c1e51"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:30.047082 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:30.047082 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:06:30.049148 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebaa9f60-ee7a-4588-9408-0ea841b2a468 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.049608 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebaa9f60-ee7a-4588-9408-0ea841b2a468 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.050415 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebaa9f60-ee7a-4588-9408-0ea841b2a468 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.051047 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebaa9f60-ee7a-4588-9408-0ea841b2a468 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.061664 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-b6117597-54ee-4139-b786-35c017ce68a8 req-543b89d0-9a62-4f90-b98e-b674c4e1e6dc service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.062574 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-b6117597-54ee-4139-b786-35c017ce68a8 req-543b89d0-9a62-4f90-b98e-b674c4e1e6dc service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.079576 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ebaa9f60-ee7a-4588-9408-0ea841b2a468 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:06:30.085055 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-b6117597-54ee-4139-b786-35c017ce68a8 req-543b89d0-9a62-4f90-b98e-b674c4e1e6dc service nova] Creating event network-changed:eb1cbd46-e972-417e-b2bd-3fa5d34c1e51 for instance c097440e-be71-4ec9-a745-018fb72e47c8 on hv-cinder-82497 Jan 28 02:06:30.094726 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-b6117597-54ee-4139-b786-35c017ce68a8 req-543b89d0-9a62-4f90-b98e-b674c4e1e6dc service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055003 Jan 28 02:06:30.096470 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 607/1217] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:30.195585 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ebaa9f60-ee7a-4588-9408-0ea841b2a468 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "DELETE /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 204 len: 0 microversion: 2.1 time: 0.157674 Jan 28 02:06:30.196747 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 611/1218] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:06:30 2022] DELETE /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:06:30.207274 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-57f2d2e9-5775-465d-b436-5e4a63b6b4af tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:30.207980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-57f2d2e9-5775-465d-b436-5e4a63b6b4af tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:30.214844 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57f2d2e9-5775-465d-b436-5e4a63b6b4af tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.215374 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57f2d2e9-5775-465d-b436-5e4a63b6b4af tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.216176 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57f2d2e9-5775-465d-b436-5e4a63b6b4af tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.216642 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57f2d2e9-5775-465d-b436-5e4a63b6b4af tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.483140 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-57f2d2e9-5775-465d-b436-5e4a63b6b4af tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:30.498615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-57f2d2e9-5775-465d-b436-5e4a63b6b4af tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1577 microversion: 2.1 time: 0.294427 Jan 28 02:06:30.500092 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 608/1219] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:30 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1577 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:31.516901 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6fbcbfba-0c2b-4298-a3d4-4193b01f6387 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:31.517606 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6fbcbfba-0c2b-4298-a3d4-4193b01f6387 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:31.524206 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6fbcbfba-0c2b-4298-a3d4-4193b01f6387 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.524656 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6fbcbfba-0c2b-4298-a3d4-4193b01f6387 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.525524 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6fbcbfba-0c2b-4298-a3d4-4193b01f6387 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.526101 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6fbcbfba-0c2b-4298-a3d4-4193b01f6387 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.679034 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6fbcbfba-0c2b-4298-a3d4-4193b01f6387 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:31.687977 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6fbcbfba-0c2b-4298-a3d4-4193b01f6387 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1458 microversion: 2.1 time: 0.175772 Jan 28 02:06:31.688560 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 612/1220] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:31 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1458 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:32.506201 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-6fc3dca0-7a2a-4f43-8e76-e7bf3dcd6d60 req-f5f1d968-1dd3-4119-8661-774c13ae2529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c097440e-be71-4ec9-a745-018fb72e47c8", "name": "network-vif-deleted", "tag": "eb1cbd46-e972-417e-b2bd-3fa5d34c1e51"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:32.508541 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:32.508541 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:06:32.519955 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-6fc3dca0-7a2a-4f43-8e76-e7bf3dcd6d60 req-f5f1d968-1dd3-4119-8661-774c13ae2529 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.520408 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-6fc3dca0-7a2a-4f43-8e76-e7bf3dcd6d60 req-f5f1d968-1dd3-4119-8661-774c13ae2529 service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.538019 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-6fc3dca0-7a2a-4f43-8e76-e7bf3dcd6d60 req-f5f1d968-1dd3-4119-8661-774c13ae2529 service nova] Creating event network-vif-deleted:eb1cbd46-e972-417e-b2bd-3fa5d34c1e51 for instance c097440e-be71-4ec9-a745-018fb72e47c8 on hv-cinder-82497 Jan 28 02:06:32.547452 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-6fc3dca0-7a2a-4f43-8e76-e7bf3dcd6d60 req-f5f1d968-1dd3-4119-8661-774c13ae2529 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046203 Jan 28 02:06:32.549378 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 609/1221] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:32.705878 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f33c3733-907c-49b2-8a27-cc58c42fca50 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:32.706489 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f33c3733-907c-49b2-8a27-cc58c42fca50 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:32.712965 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f33c3733-907c-49b2-8a27-cc58c42fca50 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.713420 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f33c3733-907c-49b2-8a27-cc58c42fca50 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.714228 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f33c3733-907c-49b2-8a27-cc58c42fca50 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.714669 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f33c3733-907c-49b2-8a27-cc58c42fca50 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.803570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f33c3733-907c-49b2-8a27-cc58c42fca50 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9cb4ec35524e859b828892c95130e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e15e80496d946b4ba64c95751ebc354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:32.816770 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f33c3733-907c-49b2-8a27-cc58c42fca50 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 200 len: 1224 microversion: 2.1 time: 0.114689 Jan 28 02:06:32.818207 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 613/1222] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:32 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:33.838761 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:33.839357 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: c097440e-be71-4ec9-a745-018fb72e47c8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:33.845843 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.846319 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.847114 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.847547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.870963 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] HTTP exception thrown: Instance c097440e-be71-4ec9-a745-018fb72e47c8 could not be found. Jan 28 02:06:33.871973 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Returning 404 to user: Instance c097440e-be71-4ec9-a745-018fb72e47c8 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:33.874130 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-09fca44d-154a-4f7d-90a7-db8f494d01f9 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8" status: 404 len: 111 microversion: 2.1 time: 0.038810 Jan 28 02:06:33.875062 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 610/1223] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:33 2022] GET /compute/v2.1/servers/c097440e-be71-4ec9-a745-018fb72e47c8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:34.848949 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:34.849574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:34.855940 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.856392 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.857898 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.858601 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.874442 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] HTTP exception thrown: Instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 could not be found. Jan 28 02:06:34.875354 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Returning 404 to user: Instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:34.876676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9fab2f34-572f-431e-ac21-df4f1b36cf07 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "DELETE /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 404 len: 111 microversion: 2.1 time: 0.031554 Jan 28 02:06:34.877523 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 614/1224] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:06:34 2022] DELETE /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:34.886820 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:34.887520 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] [instance: 95db6794-9e5c-4a0e-a565-cdf17c8174c5] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:34.893888 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.894656 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.895471 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.896104 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.917746 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] HTTP exception thrown: Instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 could not be found. Jan 28 02:06:34.918553 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Returning 404 to user: Instance 95db6794-9e5c-4a0e-a565-cdf17c8174c5 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:34.919567 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-38e8fe52-8ff6-4033-ac58-ad139752c991 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5" status: 404 len: 111 microversion: 2.1 time: 0.036909 Jan 28 02:06:34.920317 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 611/1225] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:34 2022] GET /compute/v2.1/servers/95db6794-9e5c-4a0e-a565-cdf17c8174c5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:36.281969 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-efe07753-9557-49e0-966f-b4d780e388b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] Calling method '.version_select at 0x7f523f20ca60>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:36.322219 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-efe07753-9557-49e0-966f-b4d780e388b7 tempest-TestVolumeBootPattern-1025492102 tempest-TestVolumeBootPattern-1025492102-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-363378608" status: 202 len: 0 microversion: 2.1 time: 0.047297 Jan 28 02:06:36.323818 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 615/1226] 10.222.0.96 () {58 vars in 1259 bytes} [Fri Jan 28 02:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-363378608 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:40.788253 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c7043998-1cee-4554-9fbe-c7ac296d8790 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:40.789115 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c7043998-1cee-4554-9fbe-c7ac296d8790 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:40.797025 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7043998-1cee-4554-9fbe-c7ac296d8790 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.797721 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7043998-1cee-4554-9fbe-c7ac296d8790 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.798703 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7043998-1cee-4554-9fbe-c7ac296d8790 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.799323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7043998-1cee-4554-9fbe-c7ac296d8790 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.832207 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c7043998-1cee-4554-9fbe-c7ac296d8790 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/1b9d16f0-75ec-4c1d-a7e7-acca500f9bbd" status: 200 len: 194 microversion: 2.1 time: 0.048168 Jan 28 02:06:40.832871 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 612/1227] 10.222.0.96 () {58 vars in 1412 bytes} [Fri Jan 28 02:06:40 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/1b9d16f0-75ec-4c1d-a7e7-acca500f9bbd => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:40.843500 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cbb8d87a-ca7f-4560-9696-f508598df4ee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:40.844186 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cbb8d87a-ca7f-4560-9696-f508598df4ee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:40.850444 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbb8d87a-ca7f-4560-9696-f508598df4ee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.850897 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbb8d87a-ca7f-4560-9696-f508598df4ee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.851702 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbb8d87a-ca7f-4560-9696-f508598df4ee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.852166 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbb8d87a-ca7f-4560-9696-f508598df4ee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.970775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-cbb8d87a-ca7f-4560-9696-f508598df4ee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lazy-loading 'services' on Instance uuid a917e6e7-e0b8-462a-a263-b92b3907fe5a {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:06:41.045838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cbb8d87a-ca7f-4560-9696-f508598df4ee tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/1b9d16f0-75ec-4c1d-a7e7-acca500f9bbd" status: 202 len: 0 microversion: 2.1 time: 0.206072 Jan 28 02:06:41.050101 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 616/1228] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:06:40 2022] DELETE /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/1b9d16f0-75ec-4c1d-a7e7-acca500f9bbd => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:43.313095 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d14b8fbf-d7e3-45fc-9b78-c97ab5539455 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:43.314020 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d14b8fbf-d7e3-45fc-9b78-c97ab5539455 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:43.325129 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d14b8fbf-d7e3-45fc-9b78-c97ab5539455 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.325966 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d14b8fbf-d7e3-45fc-9b78-c97ab5539455 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.327932 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d14b8fbf-d7e3-45fc-9b78-c97ab5539455 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.328770 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d14b8fbf-d7e3-45fc-9b78-c97ab5539455 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.381488 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d14b8fbf-d7e3-45fc-9b78-c97ab5539455 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/c91fcb29-3640-4ffb-a0f1-98b0baedd18a" status: 200 len: 194 microversion: 2.1 time: 0.076597 Jan 28 02:06:43.382644 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 613/1229] 10.222.0.96 () {58 vars in 1412 bytes} [Fri Jan 28 02:06:43 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/c91fcb29-3640-4ffb-a0f1-98b0baedd18a => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:43.394514 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5f63c66e-ebbe-44e1-b29c-91c5f698b1d4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:43.395264 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5f63c66e-ebbe-44e1-b29c-91c5f698b1d4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:43.402779 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5f63c66e-ebbe-44e1-b29c-91c5f698b1d4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.403474 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5f63c66e-ebbe-44e1-b29c-91c5f698b1d4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.404561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5f63c66e-ebbe-44e1-b29c-91c5f698b1d4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.405249 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5f63c66e-ebbe-44e1-b29c-91c5f698b1d4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.578101 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-5f63c66e-ebbe-44e1-b29c-91c5f698b1d4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lazy-loading 'services' on Instance uuid a917e6e7-e0b8-462a-a263-b92b3907fe5a {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:06:43.707843 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5f63c66e-ebbe-44e1-b29c-91c5f698b1d4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/c91fcb29-3640-4ffb-a0f1-98b0baedd18a" status: 202 len: 0 microversion: 2.1 time: 0.317631 Jan 28 02:06:43.713073 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 617/1230] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Jan 28 02:06:43 2022] DELETE /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments/c91fcb29-3640-4ffb-a0f1-98b0baedd18a => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:44.983982 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ed901514-789f-48b4-ac79-d323465a5be6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:44.985046 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ed901514-789f-48b4-ac79-d323465a5be6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:44.992223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed901514-789f-48b4-ac79-d323465a5be6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:44.992767 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed901514-789f-48b4-ac79-d323465a5be6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:44.993687 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed901514-789f-48b4-ac79-d323465a5be6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:44.994205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed901514-789f-48b4-ac79-d323465a5be6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.039446 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ed901514-789f-48b4-ac79-d323465a5be6 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059364 Jan 28 02:06:45.040417 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 614/1231] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:06:44 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:06:45.202952 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7f5cc1dd-1596-4a0a-b0eb-329fe12b76f8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:45.204687 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7f5cc1dd-1596-4a0a-b0eb-329fe12b76f8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:45.213151 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f5cc1dd-1596-4a0a-b0eb-329fe12b76f8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.213690 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f5cc1dd-1596-4a0a-b0eb-329fe12b76f8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.214567 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f5cc1dd-1596-4a0a-b0eb-329fe12b76f8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.215126 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f5cc1dd-1596-4a0a-b0eb-329fe12b76f8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.256390 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7f5cc1dd-1596-4a0a-b0eb-329fe12b76f8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060354 Jan 28 02:06:45.257003 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 618/1232] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Jan 28 02:06:45 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:06:45.350107 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a5b5ae07-0958-45a3-93e9-d4aa4e8d1de8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:45.350584 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a5b5ae07-0958-45a3-93e9-d4aa4e8d1de8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:45.365834 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a5b5ae07-0958-45a3-93e9-d4aa4e8d1de8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.366601 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a5b5ae07-0958-45a3-93e9-d4aa4e8d1de8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.368174 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a5b5ae07-0958-45a3-93e9-d4aa4e8d1de8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.369038 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a5b5ae07-0958-45a3-93e9-d4aa4e8d1de8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.407675 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a5b5ae07-0958-45a3-93e9-d4aa4e8d1de8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:06:45.534389 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a5b5ae07-0958-45a3-93e9-d4aa4e8d1de8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 204 len: 0 microversion: 2.1 time: 0.191071 Jan 28 02:06:45.535781 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 615/1233] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:06:45 2022] DELETE /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:06:45.545328 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ef889f96-a50d-4235-b7ee-950cefbe416f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:45.546055 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ef889f96-a50d-4235-b7ee-950cefbe416f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:45.552688 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef889f96-a50d-4235-b7ee-950cefbe416f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.553224 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef889f96-a50d-4235-b7ee-950cefbe416f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.554040 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef889f96-a50d-4235-b7ee-950cefbe416f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.554472 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef889f96-a50d-4235-b7ee-950cefbe416f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.729025 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ef889f96-a50d-4235-b7ee-950cefbe416f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:45.739256 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ef889f96-a50d-4235-b7ee-950cefbe416f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1674 microversion: 2.1 time: 0.198358 Jan 28 02:06:45.740141 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 619/1234] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:45 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:46.760231 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-11b5ee36-53b5-494d-9f8d-6439be60f0a8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:46.761086 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-11b5ee36-53b5-494d-9f8d-6439be60f0a8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:46.768141 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11b5ee36-53b5-494d-9f8d-6439be60f0a8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.768593 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11b5ee36-53b5-494d-9f8d-6439be60f0a8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.769448 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11b5ee36-53b5-494d-9f8d-6439be60f0a8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.769892 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11b5ee36-53b5-494d-9f8d-6439be60f0a8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.906980 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-11b5ee36-53b5-494d-9f8d-6439be60f0a8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:46.915608 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-11b5ee36-53b5-494d-9f8d-6439be60f0a8 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1674 microversion: 2.1 time: 0.159744 Jan 28 02:06:46.916205 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 616/1235] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:46 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:47.935825 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2e581b60-980e-4c5f-831b-c205db9f4e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:47.936972 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2e581b60-980e-4c5f-831b-c205db9f4e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:47.944397 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e581b60-980e-4c5f-831b-c205db9f4e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.945036 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e581b60-980e-4c5f-831b-c205db9f4e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.946101 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e581b60-980e-4c5f-831b-c205db9f4e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.946676 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e581b60-980e-4c5f-831b-c205db9f4e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.410385 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2e581b60-980e-4c5f-831b-c205db9f4e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b6e4c21f34cbd8d89686ce74fe07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20883c8bb00403490e966953c48afa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:48.418814 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2e581b60-980e-4c5f-831b-c205db9f4e32 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 200 len: 1674 microversion: 2.1 time: 0.487561 Jan 28 02:06:48.420377 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 620/1236] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:47 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 1674 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:48.808722 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-673dfe67-e268-417b-bf34-d6b6b6e74f03 req-a1ac5ca9-751e-417b-b154-4920e49af6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a917e6e7-e0b8-462a-a263-b92b3907fe5a", "name": "network-vif-deleted", "tag": "43ae90d8-af01-4a48-83fb-df3ffbe42efc"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:48.810862 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:48.810862 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Jan 28 02:06:48.819458 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-673dfe67-e268-417b-bf34-d6b6b6e74f03 req-a1ac5ca9-751e-417b-b154-4920e49af6bb service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.819909 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-673dfe67-e268-417b-bf34-d6b6b6e74f03 req-a1ac5ca9-751e-417b-b154-4920e49af6bb service nova] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.834127 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-673dfe67-e268-417b-bf34-d6b6b6e74f03 req-a1ac5ca9-751e-417b-b154-4920e49af6bb service nova] Creating event network-vif-deleted:43ae90d8-af01-4a48-83fb-df3ffbe42efc for instance a917e6e7-e0b8-462a-a263-b92b3907fe5a on hv-cinder-82497 Jan 28 02:06:48.840128 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-673dfe67-e268-417b-bf34-d6b6b6e74f03 req-a1ac5ca9-751e-417b-b154-4920e49af6bb service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034987 Jan 28 02:06:48.845223 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 617/1237] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:49.438914 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:49.440001 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:49.446642 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:49.447083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.447903 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:49.448344 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.464031 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] HTTP exception thrown: Instance a917e6e7-e0b8-462a-a263-b92b3907fe5a could not be found. Jan 28 02:06:49.464635 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Returning 404 to user: Instance a917e6e7-e0b8-462a-a263-b92b3907fe5a could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:49.465589 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d984acda-9d81-4b31-960b-bbf018d1ee66 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 404 len: 111 microversion: 2.1 time: 0.032564 Jan 28 02:06:49.466791 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 621/1238] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:49 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:49.480594 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-57478249-de76-40c4-822c-1bab5afea56f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '.version_select at 0x7f523f223b80>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:49.507342 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-57478249-de76-40c4-822c-1bab5afea56f tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011285764" status: 202 len: 0 microversion: 2.1 time: 0.034465 Jan 28 02:06:49.508566 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 618/1239] 10.222.0.96 () {58 vars in 1220 bytes} [Fri Jan 28 02:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011285764 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:52.811635 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:52.812322 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:52.818775 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.819229 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.820040 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.820489 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.836064 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] HTTP exception thrown: Instance a917e6e7-e0b8-462a-a263-b92b3907fe5a could not be found. Jan 28 02:06:52.836672 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Returning 404 to user: Instance a917e6e7-e0b8-462a-a263-b92b3907fe5a could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:52.837583 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2f441935-9f34-4936-ad72-1ba234c0d239 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 404 len: 111 microversion: 2.1 time: 0.030520 Jan 28 02:06:52.838159 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 622/1240] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:06:52 2022] DELETE /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:52.847247 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:52.848122 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: a917e6e7-e0b8-462a-a263-b92b3907fe5a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:52.855095 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.855547 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.857063 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.857874 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.874532 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] HTTP exception thrown: Instance a917e6e7-e0b8-462a-a263-b92b3907fe5a could not be found. Jan 28 02:06:52.875142 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Returning 404 to user: Instance a917e6e7-e0b8-462a-a263-b92b3907fe5a could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:52.876026 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8853728e-950e-4c16-981f-666568afc594 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a" status: 404 len: 111 microversion: 2.1 time: 0.033073 Jan 28 02:06:52.876598 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 619/1241] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:52 2022] GET /compute/v2.1/servers/a917e6e7-e0b8-462a-a263-b92b3907fe5a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:54.031814 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:54.032456 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:54.038838 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.039326 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.040123 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.040561 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.054967 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] HTTP exception thrown: Instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 could not be found. Jan 28 02:06:54.055570 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Returning 404 to user: Instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:54.056422 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b54bc79b-2c11-47ff-8ca0-7dac02bfb2c4 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 404 len: 111 microversion: 2.1 time: 0.029387 Jan 28 02:06:54.057041 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 623/1242] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Jan 28 02:06:54 2022] DELETE /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:54.067859 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:54.068940 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] [instance: b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:54.080548 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.081376 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.082753 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.083660 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Lock "8452b107-e1f7-4d38-8e73-ac08c235b44e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.108391 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] HTTP exception thrown: Instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 could not be found. Jan 28 02:06:54.109512 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] Returning 404 to user: Instance b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:54.111098 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e4e6f6db-d6b9-4aed-b2dc-44207d06fbc3 tempest-AttachVolumeTestJSON-723581511 tempest-AttachVolumeTestJSON-723581511-project] 10.222.0.96 "GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3" status: 404 len: 111 microversion: 2.1 time: 0.048952 Jan 28 02:06:54.112103 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 620/1243] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:54 2022] GET /compute/v2.1/servers/b24f1ace-fe24-44ba-8c14-40e1f8e1e5b3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:06:54.679217 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:06:54.679596 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: Fri Jan 28 02:06:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:06:59.872574 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e0381690-a92a-4dbc-973b-23f90b5a03a3 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Action: 'create', calling method: .version_select at 0x7f523f242820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-245378453", "metadata": {"Type": "work"}}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:59.875310 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e0381690-a92a-4dbc-973b-23f90b5a03a3 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:59.876883 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e0381690-a92a-4dbc-973b-23f90b5a03a3 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139859 Jan 28 02:06:59.877888 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 624/1244] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Jan 28 02:06:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:06:59.890726 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cfa2df64-107f-4462-ba7c-862295219c2e tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Action: 'create', calling method: .version_select at 0x7f523f0ffd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1738029833", "metadata": {"Type": "work"}}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:59.892192 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cfa2df64-107f-4462-ba7c-862295219c2e tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:59.893058 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cfa2df64-107f-4462-ba7c-862295219c2e tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007055 Jan 28 02:06:59.893603 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 621/1245] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Jan 28 02:06:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:06:59.903861 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6ea845c7-642a-409a-a3cb-2a4a0bdf580c tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Action: 'create', calling method: .version_select at 0x7f523f274310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-97869800", "metadata": {"Type": "work"}}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:59.906188 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6ea845c7-642a-409a-a3cb-2a4a0bdf580c tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:59.907053 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6ea845c7-642a-409a-a3cb-2a4a0bdf580c tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007678 Jan 28 02:06:59.907659 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 625/1246] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Jan 28 02:06:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 02:06:59.918575 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3252a574-39bb-424c-9664-b5c83a7458ca tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Calling method '.version_select at 0x7f523f223160>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:00.062323 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-3252a574-39bb-424c-9664-b5c83a7458ca tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] HTTP exception thrown: Volume tempest-invalid-1743245969 could not be found. Jan 28 02:07:00.063977 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3252a574-39bb-424c-9664-b5c83a7458ca tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Returning 404 to user: Volume tempest-invalid-1743245969 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:07:00.065177 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3252a574-39bb-424c-9664-b5c83a7458ca tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1743245969" status: 404 len: 99 microversion: 2.1 time: 0.150863 Jan 28 02:07:00.065838 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 622/1247] 10.222.0.96 () {58 vars in 1217 bytes} [Fri Jan 28 02:06:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1743245969 => generated 99 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 28 02:07:00.078617 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6bdb9973-49b1-48e6-8a92-e7252b240697 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006101 Jan 28 02:07:00.079318 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 626/1248] 10.222.0.96 () {58 vars in 1139 bytes} [Fri Jan 28 02:07:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 02:07:00.092959 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-012be337-e891-442a-87a9-cf96e7690ac7 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006068 Jan 28 02:07:00.093489 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 623/1249] 10.222.0.96 () {58 vars in 1136 bytes} [Fri Jan 28 02:07:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 02:07:00.102839 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c7d4573b-b444-44a6-af13-4870fd3ade63 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Calling method '.version_select at 0x7f523f2423a0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:00.195343 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-c7d4573b-b444-44a6-af13-4870fd3ade63 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] HTTP exception thrown: Volume 5d186e40-02d8-45db-88bf-4629cb4dac0d could not be found. Jan 28 02:07:00.195953 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c7d4573b-b444-44a6-af13-4870fd3ade63 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Returning 404 to user: Volume 5d186e40-02d8-45db-88bf-4629cb4dac0d could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:07:00.196876 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c7d4573b-b444-44a6-af13-4870fd3ade63 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/5d186e40-02d8-45db-88bf-4629cb4dac0d" status: 404 len: 109 microversion: 2.1 time: 0.097771 Jan 28 02:07:00.197448 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 627/1250] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Jan 28 02:07:00 2022] DELETE /compute/v2.1/os-volumes/5d186e40-02d8-45db-88bf-4629cb4dac0d => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:07:00.210116 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1b9a14f7-7f0c-4c06-97f8-389c16a81787 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Calling method '.version_select at 0x7f523f0cd790>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:00.239523 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-1b9a14f7-7f0c-4c06-97f8-389c16a81787 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] HTTP exception thrown: Volume 5e6e0c5a-ca4d-4791-95e1-a170024ac165 could not be found. Jan 28 02:07:00.240615 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1b9a14f7-7f0c-4c06-97f8-389c16a81787 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] Returning 404 to user: Volume 5e6e0c5a-ca4d-4791-95e1-a170024ac165 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:07:00.242146 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1b9a14f7-7f0c-4c06-97f8-389c16a81787 tempest-VolumesNegativeTest-45012490 tempest-VolumesNegativeTest-45012490-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/5e6e0c5a-ca4d-4791-95e1-a170024ac165" status: 404 len: 109 microversion: 2.1 time: 0.035625 Jan 28 02:07:00.243135 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 624/1251] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Jan 28 02:07:00 2022] GET /compute/v2.1/os-volumes/5e6e0c5a-ca4d-4791-95e1-a170024ac165 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:10:14.691749 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:10:14.692468 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: Fri Jan 28 02:10:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:10:14.810050 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:10:14.810865 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: Fri Jan 28 02:10:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:12:00.917274 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:12:00.918210 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: Fri Jan 28 02:12:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:12:13.696764 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:12:13.697394 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: Fri Jan 28 02:12:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:12:13.741220 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:12:13.742028 dv-cinder-824978-1-iscsi devstack@n-api.service[115797]: Fri Jan 28 02:12:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:12:25.677083 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:12:25.677729 dv-cinder-824978-1-iscsi devstack@n-api.service[115798]: Fri Jan 28 02:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!